May 19 07:18:07:415 [18444] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:18:28:420 [18444] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:19:03:007 [9576] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:19:07:439 [13652] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:19:28:442 [13652] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:20:03:041 [6648] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:20:07:467 [7264] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:20:28:475 [7264] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:21:03:080 [5564] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:21:07:507 [6780] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:21:28:508 [6780] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:22:03:106 [4548] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:22:07:532 [17732] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:22:28:532 [17732] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:23:03:685 [17572] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:23:07:564 [21684] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:23:28:558 [21684] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:24:03:718 [20080] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:24:07:598 [18832] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:24:28:600 [18832] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:25:03:749 [11152] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:25:07:638 [8536] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:25:28:635 [8536] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:26:03:779 [9880] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:26:07:665 [17856] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:26:28:678 [17856] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:27:03:810 [20000] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:27:07:692 [11296] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:27:28:698 [11296] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:28:03:779 [11660] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:28:07:723 [2656] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:28:28:740 [2656] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:29:03:808 [19516] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:29:07:752 [11336] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:29:28:756 [11336] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:30:03:840 [10644] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:30:07:783 [15568] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:30:28:786 [15568] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:31:03:875 [6076] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:31:07:821 [14448] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:31:28:825 [14448] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:32:03:915 [5256] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:32:07:849 [14224] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:32:28:841 [14224] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:33:03:916 [18224] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:33:07:839 [19852] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:33:28:826 [19852] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:34:03:916 [22468] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:34:07:845 [19268] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:34:28:844 [19268] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:35:03:919 [8196] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:35:07:846 [11088] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:35:28:846 [11088] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:36:03:922 [8584] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:36:07:857 [17692] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:36:28:844 [17692] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:37:03:968 [19680] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:37:07:860 [13804] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:37:28:859 [13804] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:38:03:986 [21628] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:38:07:875 [13172] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:38:28:878 [13172] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:39:04:001 [14604] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:39:07:896 [10736] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:39:28:897 [10736] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:40:04:043 [20116] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:40:07:930 [20828] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:40:28:923 [20828] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:41:04:043 [16500] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:41:07:938 [4428] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:41:28:931 [4428] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:42:04:773 [14784] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:42:07:963 [0476] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:42:28:960 [0476] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:43:04:793 [5444] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:43:08:002 [7740] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:43:28:995 [7740] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:44:04:819 [16788] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:44:07:015 [19184] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:44:28:016 [19184] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:45:04:854 [13276] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:45:07:055 [13988] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:45:28:051 [13988] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:46:04:872 [15196] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:46:07:078 [3908] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:46:28:076 [3908] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:47:04:862 [14088] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:47:07:093 [14612] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:47:28:092 [14612] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:48:04:902 [15088] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:48:07:137 [16388] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:48:28:134 [16388] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:49:04:928 [7696] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:49:07:160 [17248] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:49:28:173 [17248] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:50:04:952 [8612] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:50:07:193 [22468] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:50:28:193 [22468] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:51:04:986 [21296] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:51:07:226 [22504] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:51:28:225 [22504] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:52:05:544 [17692] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:52:07:253 [13356] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:52:28:261 [13356] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:53:05:579 [8740] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:53:07:294 [22164] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:53:28:294 [22164] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:54:05:601 [17276] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:54:07:307 [6920] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:54:28:307 [6920] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:55:05:633 [20472] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:55:07:334 [13364] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:55:28:333 [13364] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:56:05:578 [6668] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:56:07:370 [6396] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:56:28:372 [6396] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:57:05:606 [16484] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:57:07:402 [17200] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:57:28:398 [17200] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:58:05:624 [21428] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:58:07:424 [8380] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:58:28:421 [8380] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:59:05:663 [11484] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 07:59:07:463 [22520] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 07:59:28:458 [22520] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:00:05:702 [21628] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:00:07:501 [18488] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:00:28:501 [18488] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:01:05:779 [7044] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:01:07:526 [1820] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:01:28:535 [1820] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:02:05:797 [16500] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:02:07:554 [19540] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:02:28:553 [19540] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:03:05:834 [14672] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:03:07:584 [6716] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:03:28:583 [6716] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:04:05:874 [16448] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:04:07:608 [4076] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:04:28:616 [4076] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:05:05:895 [13828] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:05:07:641 [20668] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:05:28:643 [20668] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:06:05:817 [15656] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:06:07:671 [8268] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:06:28:677 [8268] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:07:05:851 [17680] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:07:07:715 [17044] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:07:28:718 [17044] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:08:05:879 [18392] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:08:07:743 [20580] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:08:28:746 [20580] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:09:05:960 [20760] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:09:07:773 [20460] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:09:28:770 [20460] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:10:05:941 [19952] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:10:07:801 [17084] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:10:28:800 [17084] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:11:05:260 [5188] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:11:07:830 [7844] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:11:28:836 [7844] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:12:05:290 [10116] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:12:07:870 [4928] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:12:28:868 [4928] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:13:05:317 [22436] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:13:07:882 [10064] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:13:28:889 [10064] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:14:05:353 [11604] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:14:07:914 [17076] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:14:28:911 [17076] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:15:05:599 [16000] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:15:07:944 [14384] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:15:28:942 [14384] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:16:05:631 [19172] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:16:07:985 [14000] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:16:28:992 [14000] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:17:05:657 [15556] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:17:07:020 [5204] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:17:28:020 [5204] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:18:05:691 [19732] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:18:07:052 [20828] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:18:28:054 [20828] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:19:05:720 [13264] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:19:07:064 [14972] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:19:28:066 [14972] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:20:05:619 [15912] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:20:07:106 [0804] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:20:28:115 [0804] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:21:05:651 [20180] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:21:07:132 [3680] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:21:28:150 [3680] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:22:05:684 [21304] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:22:07:158 [6956] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:22:28:158 [6956] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:23:05:716 [6384] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:23:07:201 [13748] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:23:28:201 [13748] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:24:05:750 [13048] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:24:07:235 [14828] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:24:28:262 [14828] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:25:05:644 [3452] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:25:07:246 [9744] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:25:28:255 [9744] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:26:05:672 [22224] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:26:07:281 [4492] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:26:28:281 [4492] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:27:05:699 [22412] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:27:07:317 [19120] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:27:28:327 [19120] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:28:05:749 [18200] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:28:07:354 [20396] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:28:28:367 [20396] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:29:05:758 [10940] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:29:07:385 [7608] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:29:28:384 [7608] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:30:05:859 [19096] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:30:07:416 [2916] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:30:28:413 [2916] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:31:05:890 [1592] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:31:07:442 [5560] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:31:28:447 [5560] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:32:05:914 [7812] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:32:07:475 [13264] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:32:28:476 [13264] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:33:05:953 [11532] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:33:07:499 [3520] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:33:28:507 [3520] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:34:05:978 [13540] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:34:07:538 [2740] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:34:28:547 [2740] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:35:05:891 [0432] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:35:07:569 [20680] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:35:28:578 [20680] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:36:05:922 [19256] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:36:07:597 [10064] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:36:28:595 [10064] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:37:05:953 [15544] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:37:07:636 [5644] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:37:28:639 [5644] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:38:05:984 [20752] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:38:07:735 [5852] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:38:28:734 [5852] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:39:06:620 [15040] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:39:07:696 [16032] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:39:28:695 [16032] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:40:06:653 [6272] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:40:07:718 [9656] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:40:28:715 [9656] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:41:06:692 [12148] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:41:07:757 [22168] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:41:28:761 [22168] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:42:06:721 [18380] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:42:07:843 [15596] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:42:28:850 [15596] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:43:06:758 [14412] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:43:07:816 [16508] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:43:28:818 [16508] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:44:06:589 [18092] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:44:07:862 [16592] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:44:28:862 [16592] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:45:06:615 [11744] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:45:07:879 [20104] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:45:28:877 [20104] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:46:06:642 [5800] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:46:07:913 [13000] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:46:28:906 [13000] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:47:06:685 [10940] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:47:07:930 [19500] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:47:28:934 [19500] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:48:06:705 [21372] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:48:07:965 [15288] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:48:28:970 [15288] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:49:06:609 [12604] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:49:07:996 [20576] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:49:29:000 [20576] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:50:06:636 [21016] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:50:07:033 [20536] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:50:28:029 [20536] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:51:06:671 [9368] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:51:07:064 [16724] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:51:28:066 [16724] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:52:06:710 [17924] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:52:07:092 [19920] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:52:28:096 [19920] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:53:06:729 [11884] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:53:07:125 [13256] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:53:28:128 [13256] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:54:06:489 [22208] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:54:07:140 [22508] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:54:28:139 [22508] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:55:06:530 [15292] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:55:07:182 [11164] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:55:28:182 [11164] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:56:06:556 [20472] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:56:07:218 [9664] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:56:28:225 [9664] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:57:06:587 [10544] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:57:07:257 [11552] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:57:28:253 [11552] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:58:06:616 [21372] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:58:07:290 [22148] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:58:28:290 [22148] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:59:06:664 [14028] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 08:59:07:318 [8584] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 08:59:28:326 [8584] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:00:06:697 [1820] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:00:07:342 [7484] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:00:28:349 [7484] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:01:06:737 [7608] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:01:07:387 [16752] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:01:28:386 [16752] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:02:06:755 [8900] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:02:07:421 [21796] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:02:28:427 [21796] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:03:06:450 [18552] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:03:07:447 [15380] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:03:28:446 [15380] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:04:06:483 [9752] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:04:07:479 [15924] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:04:28:476 [15924] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:05:06:505 [15284] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:05:07:494 [15524] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:05:28:492 [15524] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:06:06:550 [18856] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:06:07:527 [21684] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:06:28:537 [21684] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:07:06:569 [8900] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:07:07:554 [18592] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:07:28:554 [18592] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:08:06:838 [20704] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:08:07:598 [20576] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:08:28:599 [20576] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:09:06:869 [20528] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:09:07:622 [4836] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:09:28:631 [4836] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:10:06:899 [14596] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:10:07:661 [15292] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:10:28:663 [15292] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:11:06:944 [12036] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:11:07:692 [19192] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:11:28:688 [19192] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:12:06:953 [14816] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:12:07:720 [21836] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:12:28:716 [21836] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:13:06:461 [14896] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:13:07:751 [14340] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:13:28:748 [14340] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:14:06:488 [16340] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:14:07:776 [8508] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:14:28:783 [8508] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:15:06:522 [6024] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:15:07:810 [17320] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:15:28:807 [17320] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:16:06:553 [6264] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:16:07:842 [21932] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:16:28:845 [21932] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:17:06:578 [11444] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:17:07:868 [22404] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:17:28:867 [22404] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:18:06:480 [20824] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:18:07:904 [13216] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:18:28:898 [13216] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:19:06:507 [15136] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:19:08:002 [7836] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:19:29:001 [7836] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:20:06:537 [22432] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:20:07:959 [18936] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:20:28:962 [18936] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:21:06:568 [18824] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:21:07:991 [20620] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:21:28:991 [20620] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:22:06:603 [17596] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:22:07:020 [9880] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:22:28:020 [9880] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:23:06:589 [22048] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:23:07:052 [13284] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:23:28:056 [13284] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:24:06:616 [19532] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:24:07:099 [16844] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:24:28:095 [16844] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:25:06:659 [7264] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:25:07:129 [15344] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:25:28:138 [15344] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:26:06:683 [22412] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:26:07:140 [9892] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:26:28:146 [9892] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:27:06:742 [15424] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:27:07:179 [18896] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:27:28:185 [18896] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:28:06:762 [16168] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:28:07:210 [7152] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:28:28:207 [7152] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:29:06:807 [18412] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:29:07:235 [10112] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:29:28:238 [10112] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:30:06:845 [16600] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:30:07:273 [17200] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:30:28:278 [17200] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:31:06:860 [17972] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:31:07:301 [7216] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:31:28:307 [7216] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:32:06:977 [21648] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:32:07:331 [19000] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:32:28:342 [19000] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:33:06:013 [13348] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:33:07:370 [8852] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:33:28:370 [8852] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:34:06:041 [16400] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:34:07:396 [8356] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:34:28:397 [8356] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:35:06:084 [11496] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:35:07:420 [12008] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:35:28:417 [12008] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:36:06:109 [2576] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:36:07:460 [20308] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:36:28:459 [20308] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:37:06:637 [15292] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:37:07:489 [21168] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:37:28:491 [21168] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:38:06:666 [18580] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:38:07:519 [21496] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:38:28:520 [21496] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:39:06:702 [19192] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:39:07:543 [15972] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:39:28:543 [15972] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:40:06:739 [21552] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:40:07:585 [17116] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:40:28:595 [17116] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:41:06:763 [17564] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:41:07:612 [8452] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:41:28:613 [8452] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:42:06:950 [9772] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:42:07:639 [18588] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:42:28:638 [18588] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:43:06:980 [18172] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:43:07:659 [10588] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:43:28:663 [10588] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:44:07:009 [19428] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:44:07:695 [5504] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:44:28:692 [5504] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:45:07:043 [18348] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:45:07:736 [5468] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:45:28:735 [5468] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:46:07:503 [18024] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:46:07:758 [21728] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:46:28:764 [21728] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:47:07:534 [6992] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:47:07:791 [7620] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:47:28:796 [7620] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:48:07:567 [10652] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:48:07:824 [19320] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:48:28:828 [19320] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:49:07:617 [19492] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:49:07:849 [17076] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:49:28:848 [17076] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:50:07:632 [19616] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:50:07:874 [20572] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:50:28:873 [20572] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:51:07:536 [17496] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:51:07:910 [21016] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:51:28:908 [21016] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:52:07:566 [18540] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:52:07:934 [11440] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:52:28:934 [11440] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:53:07:594 [22304] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:53:07:971 [20040] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:53:28:979 [20040] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:54:07:637 [1668] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:54:07:992 [17280] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:54:28:999 [17280] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:55:07:042 [22216] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:55:07:660 [15656] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:55:28:044 [22216] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:56:07:070 [13156] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:56:07:719 [12256] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:56:28:069 [13156] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:57:07:099 [21704] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:57:07:742 [16164] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:57:28:102 [21704] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:58:07:130 [9836] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:58:07:771 [7044] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:58:28:131 [9836] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:59:07:161 [21484] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 09:59:07:807 [17464] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 09:59:28:159 [21484] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:00:07:185 [15108] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:00:07:832 [20232] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:00:28:189 [15108] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:01:07:207 [21496] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:01:07:939 [18940] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:01:28:209 [21496] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:02:07:246 [9576] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:02:07:967 [17888] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:02:28:246 [9576] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:03:07:277 [14200] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:03:07:997 [14016] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:03:28:284 [14200] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:04:07:315 [15928] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:04:08:026 [11304] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:04:28:323 [15928] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:05:07:327 [11808] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:05:08:048 [20188] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:05:28:327 [11808] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:06:07:357 [20472] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:06:08:541 [18268] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:06:28:365 [20472] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:07:07:394 [11596] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:07:08:566 [13000] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:07:28:395 [11596] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:08:07:421 [2740] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:08:08:594 [12112] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:08:28:419 [2740] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:09:07:445 [18732] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:09:08:634 [10504] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:09:28:444 [18732] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:10:07:475 [19144] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:10:08:554 [16124] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:10:28:468 [19144] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:11:07:501 [19660] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:11:08:585 [14768] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:11:28:503 [19660] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:12:07:519 [15688] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:12:08:604 [17228] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:12:28:529 [15688] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:13:07:559 [8356] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:13:08:650 [19500] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:13:28:613 [8356] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:14:07:598 [20464] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:14:08:676 [14348] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:14:28:599 [20464] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:15:07:621 [12748] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:15:08:425 [21388] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:15:28:630 [12748] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:16:07:652 [4408] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:16:08:455 [4984] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:16:28:656 [4408] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:17:07:681 [20488] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:17:08:487 [6384] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:17:28:683 [20488] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:18:07:711 [4008] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:18:08:522 [20348] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:18:28:718 [4008] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:19:07:751 [7624] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:19:08:544 [20576] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:19:28:751 [7624] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:20:07:770 [19928] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:20:08:676 [14124] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:20:28:769 [19928] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:21:07:812 [13516] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:21:08:724 [9644] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:21:28:818 [13516] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:22:07:840 [15196] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:22:08:756 [18476] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:22:28:840 [15196] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:23:07:872 [20668] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:23:08:795 [13972] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:23:28:874 [20668] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:24:07:893 [14224] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:24:08:815 [18968] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:24:28:900 [14224] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:25:07:925 [21332] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:25:08:663 [17540] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:25:28:934 [21332] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:26:07:955 [14380] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:26:08:695 [17232] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:26:28:956 [14380] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:27:07:980 [18028] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:27:08:719 [2112] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:27:28:975 [18028] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:28:07:023 [7740] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:28:08:759 [21496] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:28:28:023 [7740] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:29:07:052 [1564] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:29:08:893 [13828] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:29:28:055 [1564] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:30:07:147 [19776] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:30:08:922 [20504] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:30:28:149 [19776] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:31:07:111 [16052] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:31:08:960 [4684] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:31:28:115 [16052] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:32:07:143 [6800] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:32:08:991 [14008] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:32:28:146 [6800] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:33:07:163 [9232] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:33:08:010 [22520] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:33:28:158 [9232] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:34:07:190 [6308] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:34:08:756 [22140] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:34:28:198 [6308] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:35:07:223 [5888] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:35:08:786 [20488] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:35:28:225 [5888] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:36:07:265 [18684] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:36:08:820 [7640] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:36:28:264 [18684] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:37:07:287 [17996] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:37:08:854 [9368] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:37:28:289 [17996] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:38:07:309 [18512] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:38:08:878 [21924] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:38:28:319 [18512] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:39:07:348 [15440] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:39:08:752 [11876] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:39:28:346 [15440] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:40:07:374 [9744] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:40:08:780 [7284] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:40:28:374 [9744] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:41:07:414 [8256] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:41:08:816 [9720] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:41:28:414 [8256] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:42:07:443 [21040] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:42:08:847 [15748] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:42:28:447 [21040] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:43:07:477 [16640] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:43:08:770 [2724] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:43:28:478 [16640] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:44:07:503 [20564] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:44:08:808 [12424] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:44:28:504 [20564] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:45:07:539 [16144] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:45:08:834 [18952] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:45:28:542 [16144] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:46:07:546 [19612] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:46:08:859 [16876] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:46:28:561 [19612] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:47:07:585 [16592] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:47:08:904 [14080] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:47:28:586 [16592] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:48:07:632 [5468] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:48:08:946 [2732] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:48:28:632 [5468] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:49:07:661 [17452] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:49:08:979 [9100] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:49:28:662 [17452] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:50:07:693 [9472] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:50:09:006 [13092] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:50:28:693 [9472] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:51:07:714 [20572] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:51:09:038 [17620] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:51:28:717 [20572] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:52:07:749 [21492] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:52:09:069 [8648] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:52:28:746 [21492] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:53:07:777 [9760] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:53:09:545 [5356] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:53:28:799 [9760] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:54:07:812 [20024] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:54:09:575 [20300] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:54:28:812 [20024] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:55:07:840 [9252] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:55:09:609 [18588] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:55:28:838 [9252] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:56:07:877 [9696] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:56:09:650 [21152] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:56:28:883 [9696] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:57:07:898 [17544] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:57:09:655 [0832] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:57:28:906 [17544] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:58:07:933 [11552] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:58:09:620 [17724] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:58:28:931 [11552] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:59:07:960 [22224] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 10:59:09:654 [17340] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 10:59:28:967 [22224] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:00:07:992 [9252] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:00:09:683 [20488] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:00:28:990 [9252] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:01:07:023 [7124] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:01:09:717 [8904] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:01:28:020 [7124] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:02:07:051 [14448] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:02:09:748 [17052] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:02:28:058 [14448] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:03:07:097 [9552] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:03:09:778 [14312] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:03:28:105 [9552] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:04:07:128 [7624] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:04:09:805 [10816] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:04:28:139 [7624] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:05:07:143 [14500] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:05:09:836 [0432] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:05:28:143 [14500] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:06:07:188 [15024] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:06:09:883 [21340] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:06:28:185 [15024] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:07:07:215 [20276] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:07:09:765 [20488] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:07:28:213 [20276] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:08:07:248 [11360] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:08:09:807 [12664] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:08:28:255 [11360] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:09:07:280 [5312] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:09:09:824 [18280] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:09:28:277 [5312] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:10:07:314 [10024] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:10:09:859 [8416] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:10:28:313 [10024] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:11:07:342 [8396] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:11:09:891 [16892] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:11:28:348 [8396] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:12:07:364 [9488] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:12:09:428 [18016] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:12:28:365 [9488] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:13:07:404 [16440] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:13:09:467 [8524] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:13:28:409 [16440] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:14:07:438 [11852] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:14:09:496 [12504] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:14:28:507 [11852] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:15:07:474 [14948] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:15:09:525 [14968] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:15:28:484 [14948] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:16:07:485 [16404] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:16:09:548 [6792] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:16:28:486 [16404] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:17:07:532 [2932] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:17:09:480 [14852] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:17:28:532 [2932] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:18:07:546 [22300] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:18:09:505 [4916] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:18:28:550 [22300] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:19:07:577 [0940] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:19:09:541 [14000] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:19:28:580 [0940] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:20:07:633 [7848] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:20:09:580 [19500] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:20:28:632 [7848] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:21:07:654 [2648] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:21:09:603 [11700] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:21:28:656 [2648] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:22:07:680 [16996] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:22:09:658 [12852] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:22:28:684 [16996] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:23:07:710 [9336] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:23:09:685 [21388] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:23:28:709 [9336] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:24:07:728 [12584] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:24:09:708 [18832] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:24:28:731 [12584] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:25:07:788 [20704] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:25:09:746 [22032] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:25:28:793 [20704] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:26:07:800 [14616] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:26:09:780 [9744] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:26:28:804 [14616] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:27:07:831 [13092] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:27:09:886 [20388] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:27:28:830 [13092] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:28:07:868 [13040] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:28:09:923 [17592] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:28:28:863 [13040] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:29:07:899 [16832] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:29:09:955 [20100] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:29:28:896 [16832] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:30:07:925 [16448] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:30:09:985 [17552] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:30:28:924 [16448] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:31:07:948 [10512] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:31:10:850 [21076] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:31:10:850 [21076] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:31:28:948 [10512] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:32:07:987 [14616] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:32:10:885 [12192] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:32:28:987 [14616] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:33:07:013 [16388] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:33:10:912 [8552] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:33:28:016 [16388] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:34:07:044 [19820] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:34:10:944 [12580] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:34:28:043 [19820] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:35:07:079 [6712] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:35:10:969 [19620] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:35:28:078 [6712] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:36:07:107 [9204] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:36:11:015 [14124] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:36:28:103 [9204] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:37:07:135 [5460] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:37:11:043 [16856] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:37:28:140 [5460] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:38:07:167 [6944] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:38:11:071 [21140] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:38:28:165 [6944] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:39:07:199 [18968] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:39:11:101 [8952] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:39:28:197 [18968] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:40:07:226 [7600] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:40:11:134 [15476] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:40:28:230 [7600] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:41:07:264 [7648] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:41:11:033 [21428] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:41:28:266 [7648] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:42:07:295 [0828] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:42:11:067 [21920] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:42:28:300 [0828] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:43:07:321 [9444] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:43:11:100 [17320] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:43:28:330 [9444] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:44:07:356 [11052] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:44:11:134 [9084] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:44:28:366 [11052] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:45:07:381 [19852] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:45:11:160 [16172] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:45:28:380 [19852] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:46:07:412 [20952] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:46:11:544 [14808] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:46:28:413 [20952] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:47:07:444 [6792] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:47:11:574 [21920] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:47:28:438 [6792] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:48:07:471 [20592] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:48:11:601 [2732] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:48:28:476 [20592] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:49:07:493 [18492] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:49:11:639 [21896] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:49:28:506 [18492] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:50:07:519 [14232] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:50:11:667 [12676] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:50:28:527 [14232] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:51:07:556 [21500] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:51:11:998 [12360] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:51:28:556 [21500] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:52:07:581 [12400] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:52:12:012 [16216] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:52:28:587 [12400] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:53:07:613 [16172] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:53:12:037 [8696] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:53:28:614 [16172] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:54:07:626 [17968] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:54:12:068 [4468] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:54:28:626 [17968] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:55:07:668 [21132] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:55:12:502 [21960] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:55:28:678 [21132] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:56:07:696 [18692] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:56:12:533 [11720] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:56:28:696 [18692] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:57:07:736 [10016] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:57:12:558 [3872] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:57:28:732 [10016] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:58:07:751 [13728] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:58:12:591 [5928] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:58:28:759 [13728] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:59:07:788 [8508] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 11:59:12:625 [14892] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 11:59:28:790 [8508] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:00:07:819 [6632] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:00:12:491 [19784] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:00:28:819 [6632] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:01:07:844 [9780] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:01:12:528 [9380] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:01:28:847 [9780] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:02:07:875 [17240] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:02:12:556 [7564] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:02:28:881 [17240] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:03:07:905 [18380] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:03:12:597 [14600] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:03:28:909 [18380] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:04:07:942 [10672] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:04:12:620 [13432] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:04:28:943 [10672] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:05:07:972 [16700] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:05:12:578 [16788] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:05:28:972 [16700] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:06:07:999 [14432] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:06:12:608 [12844] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:06:29:003 [14432] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:07:07:020 [19808] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:07:12:639 [6972] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:07:28:017 [19808] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:08:07:120 [16640] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:08:12:676 [12676] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:08:28:121 [16640] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:09:07:088 [14912] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:09:12:697 [3740] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:09:28:096 [14912] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:10:07:116 [5624] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:10:12:617 [11852] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:10:28:118 [5624] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:11:07:148 [20704] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:11:12:655 [18128] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:11:28:156 [20704] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:12:07:180 [7156] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:12:12:672 [13364] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:12:28:191 [7156] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:13:07:209 [10508] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:13:12:707 [17052] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:13:28:215 [10508] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:14:07:253 [6552] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:14:12:308 [21056] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:14:28:252 [6552] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:15:07:286 [18196] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:15:12:340 [18028] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:15:28:285 [18196] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:16:07:314 [16452] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:16:12:369 [7836] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:16:28:316 [16452] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:17:07:340 [14968] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:17:12:401 [10088] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:17:28:349 [14968] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:18:07:378 [17364] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:18:12:430 [6376] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:18:28:375 [17364] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:19:07:408 [16832] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:19:14:507 [8520] cluster: ################# START #################
May 19 12:19:14:507 [8520] cluster: cluster 3.50
May 19 12:19:14:507 [8520] cluster: Nimsoft Corp
May 19 12:19:14:508 [8520] cluster: SREQUEST: probe_checkin ->10.27.163.135/48000
May 19 12:19:14:508 [8520] cluster:  head   tout=15 addr=
May 19 12:19:14:508 [8520] cluster:  data   type=1 nimcprid=701090
May 19 12:19:14:509 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=617
May 19 12:19:14:509 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:14:509 [8520] cluster: sockClose:0000000000B38ED0:10.27.163.135/56038
May 19 12:19:14:509 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:14:509 [8520] cluster:  head   tout=15 addr=
May 19 12:19:14:509 [8520] cluster: sslClientSetup - mode=0 cipher=DEFAULT
May 19 12:19:14:509 [8520] cluster: nimSessionServerStrict - host 10.27.163.135, port = 0
May 19 12:19:15:516 [8520] cluster: sockCheckLocalPort: connect to port 48008 failed 10061 (ok - its free)
May 19 12:19:15:516 [8520] cluster: sockCheckLocalPort - closesocket 448
May 19 12:19:15:516 [8520] cluster: sockServer: next available port is 48008
May 19 12:19:15:516 [8520] cluster: sockServer:0000000000B38ED0:10.27.163.135/48008
May 19 12:19:15:516 [8520] cluster: port=48008 PID=7100 loglevel=5
May 19 12:19:15:516 [8520] cluster: cwd=C:\Program Files\Nimsoft\probes\application\cluster
May 19 12:19:15:516 [8520] cluster: SREQUEST: port_register ->10.27.163.135/48000
May 19 12:19:15:516 [8520] cluster:  head   tout=20 addr=
May 19 12:19:15:516 [8520] cluster:  data   name=cluster port=48008
May 19 12:19:15:516 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=0
May 19 12:19:15:516 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:15:516 [8520] cluster: sockClose:0000000000B3E3A0:10.27.163.135/56042
May 19 12:19:15:516 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:15:516 [8520] cluster:  head   tout=20 addr=
May 19 12:19:15:517 [8520] cluster: ProbeInfoInitialize(): - IN
May 19 12:19:15:517 [8520] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:15:517 [8520] cluster:  head   tout=15 addr=
May 19 12:19:15:517 [8520] cluster:  data   name=controller
May 19 12:19:15:518 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:15:518 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:15:518 [8520] cluster:  data   port=48000 ip=10.27.163.135
May 19 12:19:15:518 [8520] cluster: sockClose:0000000000B3F860:10.27.163.135/56043
May 19 12:19:15:518 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:15:518 [8520] cluster:  head   tout=15 addr=
May 19 12:19:15:518 [8520] cluster: SREQUEST: get_info ->10.27.163.135/48000
May 19 12:19:15:518 [8520] cluster:  head   tout=10 addr=controller
May 19 12:19:15:519 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=1034
May 19 12:19:15:519 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:15:519 [8520] cluster:  data   spoolport=48001 last_inst_change=1589714509
May 19 12:19:15:519 [8520] cluster: SREQUEST: probe_list ->10.27.163.135/48000
May 19 12:19:15:519 [8520] cluster:  head   tout=10 addr=controller
May 19 12:19:15:522 [8520] cluster: RREPLY: status=permission denied(6) <-10.27.163.135/48000  h=37 d=0
May 19 12:19:15:522 [8520] cluster:  head   mtype=200 status=6 seq=1
May 19 12:19:15:522 [8520] cluster: nimSessionRequest - get SID for the probe cluster
May 19 12:19:15:522 [8520] cluster: nimGetIpList called with buffer size 40960
May 19 12:19:15:522 [8520] cluster: nimGetIpList - found |169.254.150.189|169.254.219.141|169.254.17.140|10.30.107.91|10.27.163.135|10.30.122.4|169.254.1.128|
May 19 12:19:15:522 [8520] cluster: SREQUEST: login ->10.27.163.135/48000
May 19 12:19:15:522 [8520] cluster:  head   tout=15 addr=
May 19 12:19:15:522 [8520] cluster:  data   type=1 nimcprid=701090 prid=cluster
May 19 12:19:15:525 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=243
May 19 12:19:15:525 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:15:525 [8520] cluster: sockClose:0000000000B3F860:10.27.163.135/56046
May 19 12:19:15:525 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:15:525 [8520] cluster:  head   tout=15 addr=
May 19 12:19:15:525 [8520] cluster: SREQUEST: probe_list ->10.27.163.135/48000
May 19 12:19:15:529 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=4623
May 19 12:19:15:529 [8520] cluster:  head   mtype=200 status=0 seq=2
May 19 12:19:15:529 [8520] cluster:  data   cdm=PDS(526)
May 19 12:19:15:529 [8520] cluster: ProbesInitialize - key=controller type=21 size=466
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew - 'controller' can not be clustered.
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:529 [8520] cluster: ProbesInitialize - key=spooler type=21 size=471
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew - 'spooler' can not be clustered.
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:529 [8520] cluster: ProbesInitialize - key=hdb type=21 size=466
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew - 'hdb' can not be clustered.
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:529 [8520] cluster: ProbesInitialize - key=cluster type=21 size=513
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew - 'cluster' can not be clustered.
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:529 [8520] cluster: ProbesInitialize - key=ntevl type=21 size=509
May 19 12:19:15:529 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:560 [8520] cluster: ProbeInfoNew - probe=ntevl cfg=C:\Program Files\Nimsoft\probes/system/ntevl\ntevl.cfg
May 19 12:19:15:561 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:561 [8520] cluster: ProbesInitialize - key=nexec type=21 size=491
May 19 12:19:15:561 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:572 [8520] cluster: ProbeInfoNew - probe=nexec cfg=C:\Program Files\Nimsoft\probes/service/nexec\nexec.cfg
May 19 12:19:15:572 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:572 [8520] cluster: ProbesInitialize - key=sqlserver type=21 size=532
May 19 12:19:15:572 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:659 [8520] cluster: ProbeInfoNew - probe=sqlserver cfg=C:\Program Files\Nimsoft\probes/database/sqlserver\sqlserver_monitor.cfg
May 19 12:19:15:659 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:659 [8520] cluster: ProbesInitialize - key=ntservices type=21 size=518
May 19 12:19:15:659 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:676 [8520] cluster: ProbeInfoNew - probe=ntservices cfg=C:\Program Files\Nimsoft\probes/system/ntservices\ntservices.cfg
May 19 12:19:15:676 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:676 [8520] cluster: ProbesInitialize - key=cdm type=21 size=526
May 19 12:19:15:676 [8520] cluster: ProbeInfoNew(): - IN
May 19 12:19:15:677 [8520] cluster: ProbeInfoNew - probe=cdm cfg=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:15:677 [8520] cluster: ProbeInfoNew(): - OUT
May 19 12:19:15:677 [8520] cluster: sockClose:0000000000B3E3A0:10.27.163.135/56044
May 19 12:19:15:677 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:15:677 [8520] cluster: ProbeInfoInitialize(): - OUT
May 19 12:19:15:677 [8520] cluster: InitializePlugin(): - IN
May 19 12:19:15:678 [8520] cluster: InitializePlugin - reading section[/cluster] key[plugin] value[windows_mscs]
May 19 12:19:15:678 [8520] cluster: GetPluginFile(): - IN
May 19 12:19:15:678 [8520] cluster: GetPluginFile - windows_mscs: windows_mscs.dll
May 19 12:19:15:678 [8520] cluster: GetPluginFile(): - IN
May 19 12:19:15:688 [8520] cluster: InitializePlugin - plugin 'windows_mscs.dll' loaded
May 19 12:19:15:688 [8520] cluster: InitializePlugin(): - OUT
May 19 12:19:15:689 [8520] cluster: SREQUEST: gethub ->10.27.163.135/48000
May 19 12:19:15:689 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=451
May 19 12:19:15:689 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:15:689 [8520] cluster: sockClose:0000000001037070:10.27.163.135/56049
May 19 12:19:15:689 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:15:689 [8520] cluster: InitalizeCluster(): - IN
May 19 12:19:15:690 [8520] cluster: InitalizeCluster - Send definition QOS_CLUSTER_GROUP_STATE
May 19 12:19:15:690 [8520] cluster: SREQUEST: post ->10.27.163.135/48001
May 19 12:19:15:690 [8520] cluster:  data   unit=State unit_short=state flags=8192 type=1
May 19 12:19:15:690 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:15:690 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:15:690 [8520] cluster:  data   nimid=NR94975670-08714
May 19 12:19:15:690 [8520] cluster: sockClose:0000000001037070:10.27.163.135/56050
May 19 12:19:15:690 [8520] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:15:690 [8520] cluster: InitalizeCluster - Send definition QOS_CLUSTER_NODE_STATE
May 19 12:19:15:691 [8520] cluster: SREQUEST: post ->10.27.163.135/48001
May 19 12:19:15:691 [8520] cluster:  data   unit=State unit_short=state flags=8192 type=1
May 19 12:19:15:691 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:15:691 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:15:691 [8520] cluster:  data   nimid=NR94975670-08715
May 19 12:19:15:691 [8520] cluster: sockClose:0000000001037070:10.27.163.135/56051
May 19 12:19:15:691 [8520] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:15:691 [8520] cluster: ReadConfigVersion(): - IN
May 19 12:19:15:691 [8520] cluster: ReadConfigVersion - section=/cluster md5=43659d70bca3935b9edee12bfb6a8f05 ver=2
May 19 12:19:15:691 [8520] cluster: ReadConfigVersion(): - OUT
May 19 12:19:15:691 [8520] cluster: CheckConfigVersion(): - IN
May 19 12:19:15:691 [8520] cluster: PdsFromSection(): - IN
May 19 12:19:15:691 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:691 [8520] cluster: PdsFromSection - section=/cluster size=74
May 19 12:19:15:691 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:691 [8520] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:19:15:691 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:691 [8520] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:19:15:691 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:691 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:692 [8520] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:692 [8520] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:692 [8520] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:692 [8520] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:692 [8520] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - IN
May 19 12:19:15:692 [8520] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: recursive_section2pds(): - OUT
May 19 12:19:15:692 [8520] cluster: PdsFromSection(): - OUT
May 19 12:19:15:692 [8520] cluster: MD5SumSection - file=cluster.cfg section=/cluster MD5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:19:15:692 [8520] cluster: CheckConfigVersion(): - OUT
May 19 12:19:15:692 [8520] cluster: SetupNodes(): - IN
May 19 12:19:15:692 [8520] cluster: SetupNodes - node=FRHDCLI-APBCT01 address=10.27.163.135
May 19 12:19:15:692 [8520] cluster: SetupNodes - node=FRHDSTD-APBCT01 address=10.30.10.16
May 19 12:19:15:692 [8520] cluster: SetupNodes(): - OUT
May 19 12:19:15:692 [8520] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:15:692 [8520] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:15:692 [8520] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:15:692 [8520] cluster: FindNode() End - OUT
May 19 12:19:15:692 [8520] cluster: InitalizeCluster - this node 'FRHDCLI-APBCT01' was found in the configuration
May 19 12:19:15:692 [8520] cluster: InitalizeCluster - this node=FRHDCLI-APBCT01 IP=10.27.163.135
May 19 12:19:15:692 [8520] cluster: InitalizeCluster(): - OUT
May 19 12:19:15:692 [8520] cluster: Initialize Cluster OK!
May 19 12:19:15:692 [8520] cluster: InitializeResourceGroups(): - IN
May 19 12:19:15:693 [8520] cluster: ReadConfigVersion(): - IN
May 19 12:19:15:693 [8520] cluster: ReadConfigVersion(): - OUT
May 19 12:19:15:693 [8520] cluster: SetupGroups - Found section path: /groups/Available Storage
May 19 12:19:15:693 [8520] cluster: NewGroup(): - IN
May 19 12:19:15:693 [8520] cluster: NewGroup(): - OUT
May 19 12:19:15:693 [8520] cluster: SetupGroups - name=Available Storage
May 19 12:19:15:693 [8520] cluster: SetupGroups - Found section path: /groups/Cluster Group
May 19 12:19:15:693 [8520] cluster: NewGroup(): - IN
May 19 12:19:15:693 [8520] cluster: NewGroup(): - OUT
May 19 12:19:15:693 [8520] cluster: SetupGroups - name=Cluster Group
May 19 12:19:15:693 [8520] cluster: SetupGroups - Found section path: /groups/FRHDGSP-APBCT03
May 19 12:19:15:693 [8520] cluster: NewGroup(): - IN
May 19 12:19:15:693 [8520] cluster: NewGroup(): - OUT
May 19 12:19:15:693 [8520] cluster: SetupGroups - name=FRHDGSP-APBCT03
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/1
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/disk/alarm/fixed/E:\
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/2
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/disk/alarm/fixed/F:\
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/4
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=ntservices profile=/services/MSSQL$APBCT100PPI
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/5
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=ntservices profile=/services/SQLAgent$APBCT100PPI
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/7
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/6
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=sqlserver profile=/connections
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/0
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT03 - Resource section: /groups/FRHDGSP-APBCT03/8
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/messages
May 19 12:19:15:693 [8520] cluster: SetupGroups - Found section path: /groups/FRHDGSP-APBCT40
May 19 12:19:15:693 [8520] cluster: NewGroup(): - IN
May 19 12:19:15:693 [8520] cluster: NewGroup(): - OUT
May 19 12:19:15:693 [8520] cluster: SetupGroups - name=FRHDGSP-APBCT40
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT40 - Resource section: /groups/FRHDGSP-APBCT40/0
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT40 - Resource section: /groups/FRHDGSP-APBCT40/1
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/messages
May 19 12:19:15:693 [8520] cluster: SetupGroups - Found section path: /groups/FRHDGSP-APBCT50
May 19 12:19:15:693 [8520] cluster: NewGroup(): - IN
May 19 12:19:15:693 [8520] cluster: NewGroup(): - OUT
May 19 12:19:15:693 [8520] cluster: SetupGroups - name=FRHDGSP-APBCT50
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT50 - Resource section: /groups/FRHDGSP-APBCT50/0
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk
May 19 12:19:15:693 [8520] cluster: SetupGroups: FRHDGSP-APBCT50 - Resource section: /groups/FRHDGSP-APBCT50/1
May 19 12:19:15:693 [8520] cluster: SetupResource - probe=cdm profile=/messages
May 19 12:19:15:693 [8520] cluster: InitializeResourceGroups(): - OUT
May 19 12:19:15:693 [8520] cluster: Initialize Resource Groups OK!
May 19 12:19:15:694 [8520] cluster: udp is starting in thread 20420
May 19 12:19:15:694 [8520] cluster: main - adding Sleep 10
May 19 12:19:15:694 [20420] cluster: udp_thread - Node and Group synchronizer thread started!
May 19 12:19:15:694 [20420] cluster: nimSessionServer - port = 48003
May 19 12:19:16:696 [20420] cluster: sockCheckLocalPort: connect to port 48003 failed 10061 (ok - its free)
May 19 12:19:16:696 [20420] cluster: sockCheckLocalPort - closesocket 600
May 19 12:19:16:696 [20420] cluster: sockServer:0000000000B5F5E0:0.0.0.0/48003
May 19 12:19:17:696 [8520] cluster: (Main)update node & group conf is starting in thread 7824
May 19 12:19:17:696 [8520] cluster: main - adding Sleep 10
May 19 12:19:17:696 [7824] cluster: doWork(): - IN
May 19 12:19:17:696 [7824] cluster: doWork - check nodes - do connection
May 19 12:19:17:696 [7824] cluster: ConnectAllNodes(): - IN
May 19 12:19:17:696 [7824] cluster: (ConnectAllNodes) - Start
May 19 12:19:17:696 [7824] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:19:17:696 [7824] cluster: ConnectToNode(): - IN
May 19 12:19:17:696 [7824] cluster: controller port is 48000
May 19 12:19:17:697 [20420] cluster: update node & group conf is starting in thread 12644
May 19 12:19:17:697 [12644] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:19:17:697 [12644] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:19:17:697 [12644] cluster: child udp_thread
May 19 12:19:17:697 [12644] cluster: child udp - Update node configs
May 19 12:19:17:697 [12644] cluster: updateNodeConf(): - IN
May 19 12:19:17:697 [12644] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:19:17:697 [12644] cluster: NodeConfigurationRequest(): - IN
May 19 12:19:17:697 [12644] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:19:17:697 [12644] cluster: PdsFromSection(): - IN
May 19 12:19:17:697 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:697 [12644] cluster: PdsFromSection - section=/cluster size=74
May 19 12:19:17:697 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:697 [12644] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:19:17:697 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:697 [12644] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:19:17:697 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:697 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:697 [12644] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:698 [12644] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:698 [12644] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:698 [12644] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:698 [12644] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - IN
May 19 12:19:17:698 [12644] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: recursive_section2pds(): - OUT
May 19 12:19:17:698 [12644] cluster: PdsFromSection(): - OUT
May 19 12:19:17:698 [12644] cluster: NodeConfigurationRequest(): - OUT
May 19 12:19:17:698 [12644] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:19:18:403 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:18:403 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56532  h=298 d=1417
May 19 12:19:18:403 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:19:18:403 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:19:18:403 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:19:18:403 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:19:18:403 [20420] cluster: set_node_version - from 10.27.163.134/56532 [0x10304d0]
May 19 12:19:18:403 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:19:18:403 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:19:18:403 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56532
May 19 12:19:18:403 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:18:403 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:19:18:403 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:19:18:403 [20420] cluster: RREQUEST: _close <-10.27.163.134/56532  h=287 d=0
May 19 12:19:18:403 [20420] cluster: sockClose:00000000010304D0:10.27.163.135/48003
May 19 12:19:18:404 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56533  h=299 d=866
May 19 12:19:18:405 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:19:18:405 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:19:18:405 [20420] cluster: set_group_version - from 10.27.163.134/56533 [0x10304d0]
May 19 12:19:18:405 [20420] cluster: set_group_version - pds received, size=866
May 19 12:19:18:405 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:19:18:405 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:19:18:405 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:19:18:405 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:19:18:405 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:19:18:405 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:19:18:405 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:19:18:405 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:19:18:405 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:19:18:405 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:19:18:405 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:19:18:405 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:19:18:405 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56533
May 19 12:19:18:405 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:18:405 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:19:18:405 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:19:18:405 [20420] cluster: RREQUEST: _close <-10.27.163.134/56533  h=287 d=0
May 19 12:19:18:406 [20420] cluster: sockClose:00000000010304D0:10.27.163.135/48003
May 19 12:19:19:407 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:19:698 [8520] cluster: main - adding Sleep 10
May 19 12:19:20:408 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:21:409 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:21:699 [8520] cluster: main - adding Sleep 10
May 19 12:19:22:410 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:22:696 [7824] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:19:22:696 [7824] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:19:22:696 [7824] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:19:22:696 [7824] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:19:22:696 [7824] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:19:22:696 [7824] cluster: ConnectAllNodes(): - OUT
May 19 12:19:22:696 [7824] cluster: Not connected to any nodes!
May 19 12:19:22:696 [7824] cluster: doWork - check nodes - state
May 19 12:19:22:696 [7824] cluster: CheckNodeState(): - Starting IN
May 19 12:19:22:701 [7824] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:22:701 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:22:701 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:22:702 [7824] cluster: FindNode() End - OUT
May 19 12:19:22:702 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:702 [7824] cluster: ciOpen - initializing global CI cache
May 19 12:19:22:702 [7824] cluster: ciSave - saving CI   [C0BDD9BE7E9DD37C330DAE09C6DCEAF7D]
May 19 12:19:22:702 [7824] cluster: CheckNodeState - Sending QoS - Node=FRHDCLI-APBCT01, state=1 (Up)
May 19 12:19:22:702 [7824] cluster: ciSaveMetric - saving MET [MBB2F3CB4A2CD65AC4B6C7DC87D3343CF] 1.18:2
May 19 12:19:22:703 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:703 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:703 [7824] cluster:  data   nimid=NR94975670-08716
May 19 12:19:22:703 [7824] cluster: CheckNodeState - QoS: target: FRHDCLI-APBCT01, value: 1
May 19 12:19:22:703 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56058
May 19 12:19:22:703 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:704 [7824] cluster: ciClose - [C0BDD9BE7E9DD37C330DAE09C6DCEAF7D]
May 19 12:19:22:704 [7824] cluster: CheckNodeState - node=FRHDCLI-APBCT01 is up
May 19 12:19:22:704 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:704 [7824] cluster: SendAlarm - sev=0 msg=Cluster node 'FRHDCLI-APBCT01' is Up. sup=cluster/FRHDCLI-APBCT01 src=
May 19 12:19:22:704 [7824] cluster: ciPostMessage - alarm
May 19 12:19:22:704 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:704 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:704 [7824] cluster:  data   nimid=NR94975670-08717
May 19 12:19:22:704 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56059
May 19 12:19:22:704 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:704 [7824] cluster: ciClose - [C0BDD9BE7E9DD37C330DAE09C6DCEAF7D]
May 19 12:19:22:704 [7824] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:19:22:704 [7824] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:19:22:704 [7824] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:22:704 [7824] cluster: FindNode() End - OUT
May 19 12:19:22:704 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:704 [7824] cluster: ciSave - saving CI   [CF9021C31FA7D48A0B1A53F4D1D464CA6]
May 19 12:19:22:705 [7824] cluster: CheckNodeState - Sending QoS - Node=FRHDSTD-APBCT01, state=1 (Up)
May 19 12:19:22:705 [7824] cluster: ciSaveMetric - saving MET [M2F658BED0C7FAF7F7B16ECF3F4BBD86F] 1.18:2
May 19 12:19:22:706 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:706 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:706 [7824] cluster:  data   nimid=NR94975670-08718
May 19 12:19:22:706 [7824] cluster: CheckNodeState - QoS: target: FRHDSTD-APBCT01, value: 1
May 19 12:19:22:706 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56060
May 19 12:19:22:706 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:706 [7824] cluster: ciClose - [CF9021C31FA7D48A0B1A53F4D1D464CA6]
May 19 12:19:22:706 [7824] cluster: CheckNodeState - node=FRHDSTD-APBCT01 is up
May 19 12:19:22:706 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:706 [7824] cluster: SendAlarm - sev=0 msg=Cluster node 'FRHDSTD-APBCT01' is Up. sup=cluster/FRHDSTD-APBCT01 src=
May 19 12:19:22:706 [7824] cluster: ciPostMessage - alarm
May 19 12:19:22:706 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:706 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:706 [7824] cluster:  data   nimid=NR94975670-08719
May 19 12:19:22:706 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56061
May 19 12:19:22:706 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:707 [7824] cluster: ciClose - [CF9021C31FA7D48A0B1A53F4D1D464CA6]
May 19 12:19:22:707 [7824] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:19:22:707 [7824] cluster: CheckNodeState(): - OUT
May 19 12:19:22:707 [7824] cluster: doWork - check nodes - any new probes installed
May 19 12:19:22:707 [7824] cluster: ProbeInfoCheck(): - IN
May 19 12:19:22:707 [7824] cluster: ProbeInfoCheck - controller.cfg initialized at Tue May 19 12:19:00 2020
 
May 19 12:19:22:707 [7824] cluster: doWork - check groups
May 19 12:19:22:707 [7824] cluster: MapResourceGroups(): - IN
May 19 12:19:22:707 [7824] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:22:730 [7824] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:22:730 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:22:730 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:22:730 [7824] cluster: FindNode() End - OUT
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:22:730 [7824] cluster: FindGroup(): - IN
May 19 12:19:22:730 [7824] cluster: FindGroup(): - OUT
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - resource group 'Available Storage' is running on cluster node 'FRHDCLI-APBCT01'
May 19 12:19:22:730 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:22:730 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - (Alarm Check)Ci Name is 
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - state = 0 : Send Clear Alarm
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - Msg = Resource group 'Available Storage' is Online.Resources: No Resources
May 19 12:19:22:730 [7824] cluster: MapResourceGroups - Token = (null)
May 19 12:19:22:730 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:730 [7824] cluster: ciSave - saving CI   [CE3DFD8143780A9701FDE557E42A4D4BC]
May 19 12:19:22:731 [7824] cluster: SendAlarm - sev=0 msg=Resource group 'Available Storage' is Online.Resources: No Resources sup=cluster/Available Storage src=
May 19 12:19:22:731 [7824] cluster: ciSaveMetric - saving MET [M74141379FFB6ED561D49C6FE8AF0222F] 1.18:1
May 19 12:19:22:731 [7824] cluster: ciPostMessage - alarm
May 19 12:19:22:732 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:732 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:732 [7824] cluster:  data   nimid=NR94975670-08720
May 19 12:19:22:732 [7824] cluster: sockClose:0000000001037070:10.27.163.135/56062
May 19 12:19:22:732 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:732 [7824] cluster: ciClose - [CE3DFD8143780A9701FDE557E42A4D4BC]
May 19 12:19:22:732 [7824] cluster: SetResourceGroupOnline(): - IN
May 19 12:19:22:732 [7824] cluster: SetResourceGroupOnline - Available Storage
May 19 12:19:22:732 [7824] cluster: SetResourceGroupOnline(): - OUT
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - group=Available Storage is Online
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - pchMsg set Free
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - CiName set to FRHDCLI-APBCT01-Available Storage
May 19 12:19:22:732 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - Successfuly open ciOpenLocalDevice
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - Sending QoS - Group=Available Storage, state=1 (Online)
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - set QoS Sample time
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - QoS Binding Done
May 19 12:19:22:732 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:732 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:732 [7824] cluster:  data   nimid=NR94975670-08721
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - QoS Sent
May 19 12:19:22:732 [7824] cluster: MapResourceGroups - QoS un Binding Done
May 19 12:19:22:732 [7824] cluster: sockClose:0000000001037070:10.27.163.135/56063
May 19 12:19:22:732 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:733 [7824] cluster: ciClose - [CE3DFD8143780A9701FDE557E42A4D4BC]
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - local Qos and ci Closed
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - pds Deleted
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:22:733 [7824] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:22:733 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:22:733 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:22:733 [7824] cluster: FindNode() End - OUT
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:22:733 [7824] cluster: FindGroup(): - IN
May 19 12:19:22:733 [7824] cluster: FindGroup(): - OUT
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - resource group 'Cluster Group' is running on cluster node 'FRHDCLI-APBCT01'
May 19 12:19:22:733 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:22:733 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - (Alarm Check)Ci Name is 
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - state = 0 : Send Clear Alarm
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - Msg = Resource group 'Cluster Group' is Online.Resources: 'Cluster IP Address' :Online   'Cluster Name' :Online   'File Share Witness' :Online   
May 19 12:19:22:733 [7824] cluster: MapResourceGroups - Token = (null)
May 19 12:19:22:733 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:733 [7824] cluster: ciSave - saving CI   [C8D499103C51E49DCD767C9FF6C6CDED2]
May 19 12:19:22:733 [7824] cluster: SendAlarm - sev=0 msg=Resource group 'Cluster Group' is Online.Resources: 'Cluster IP Address' :Online   'Cluster Name' :Online   'File Share Witness' :Online    sup=cluster/Cluster Group src=
May 19 12:19:22:733 [7824] cluster: ciSaveMetric - saving MET [M47394E8A2E85B639CF1C47D2A2D5CBE0] 1.18:1
May 19 12:19:22:734 [7824] cluster: ciPostMessage - alarm
May 19 12:19:22:734 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:734 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:734 [7824] cluster:  data   nimid=NR94975670-08722
May 19 12:19:22:734 [7824] cluster: sockClose:0000000001037070:10.27.163.135/56064
May 19 12:19:22:734 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:734 [7824] cluster: ciClose - [C8D499103C51E49DCD767C9FF6C6CDED2]
May 19 12:19:22:734 [7824] cluster: SetResourceGroupOnline(): - IN
May 19 12:19:22:734 [7824] cluster: SetResourceGroupOnline - Cluster Group
May 19 12:19:22:734 [7824] cluster: SetResourceGroupOnline(): - OUT
May 19 12:19:22:734 [7824] cluster: MapResourceGroups - group=Cluster Group is Online
May 19 12:19:22:734 [7824] cluster: MapResourceGroups - pchMsg set Free
May 19 12:19:22:734 [7824] cluster: MapResourceGroups - CiName set to FRHDCLI-APBCT01-Cluster Group
May 19 12:19:22:734 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - Successfuly open ciOpenLocalDevice
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - Sending QoS - Group=Cluster Group, state=1 (Online)
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - set QoS Sample time
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - QoS Binding Done
May 19 12:19:22:735 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:735 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:735 [7824] cluster:  data   nimid=NR94975670-08723
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - QoS Sent
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - QoS un Binding Done
May 19 12:19:22:735 [7824] cluster: sockClose:0000000001037070:10.27.163.135/56065
May 19 12:19:22:735 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:735 [7824] cluster: ciClose - [C8D499103C51E49DCD767C9FF6C6CDED2]
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - local Qos and ci Closed
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - pds Deleted
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:22:735 [7824] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:22:735 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:22:735 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:22:735 [7824] cluster: FindNode() End - OUT
May 19 12:19:22:735 [7824] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:22:735 [7824] cluster: FindGroup(): - IN
May 19 12:19:22:735 [7824] cluster: FindGroup(): - OUT
May 19 12:19:22:736 [7824] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:19:22:736 [7824] cluster: MapResourceGroups - resource group 'FRHDGSP-APBCT03' is running on cluster node 'FRHDCLI-APBCT01'
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT03 is inactive
May 19 12:19:22:736 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:22:736 [7824] cluster: MapResourceGroups - (Alarm Check)Ci Name is 
May 19 12:19:22:736 [7824] cluster: MapResourceGroups - state = 0 : Send Clear Alarm
May 19 12:19:22:736 [7824] cluster: MapResourceGroups - Msg = Resource group 'FRHDGSP-APBCT03' is Online.Resources: 'AlertSwitchOver Script' :Online   'Cluster Disk 1' :Online   'Cluster Disk 4' :Online   'Cluster Disk 6' :Online   'Control-M/Agent FRHDGSP-APBCT30' :Online   'Control-M/Agent FRHDGSP-APBCT30_new' :Online   'HSC_FRHDGSP-APBCT03' :Online   'SQL IP Address 1 (FRHDGSP-APBCT30)' :Online   'SQL IP Address 2 (FRHDGSP-APBCT30)' :Online   'SQL Network Name (FRHDGSP-APBCT30)' :Online   'SQL Server (APBCT100PPI)' :Online   'SQL Server Agent (APBCT100PPI)' :Online   
May 19 12:19:22:736 [7824] cluster: MapResourceGroups - Token = (null)
May 19 12:19:22:736 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:736 [7824] cluster: ciSave - saving CI   [C07340468AFBEF0B55F4CDA8F9F39181F]
May 19 12:19:22:736 [7824] cluster: SendAlarm - sev=0 msg=Resource group 'FRHDGSP-APBCT03' is Online.Resources: 'AlertSwitchOver Script' :Online   'Cluster Disk 1' :Online   'Cluster Disk 4' :Online   'Cluster Disk 6' :Online   'Control-M/Agent FRHDGSP-APBCT30' :Online   'Control-M/Agent FRHDGSP-APBCT30_new' :Online   'HSC_FRHDGSP-APBCT03' :Online   'SQL IP Address 1 (FRHDGSP-APBCT30)' :Online   'SQL IP Address 2 (FRHDGSP-APBCT30)' :Online   'SQL Network Name (FRHDGSP-APBCT30)' :Online   'SQL Server (APBCT100PPI)' :Online   'SQL Server Agent (APBCT100PPI)' :Online    sup=cluster/FRHDGSP-APBCT03 src=
May 19 12:19:22:736 [7824] cluster: ciSaveMetric - saving MET [M4A25AD4F98F8C4C56F7E440F4D7B0DAF] 1.18:1
May 19 12:19:22:737 [7824] cluster: ciPostMessage - alarm
May 19 12:19:22:737 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:737 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:737 [7824] cluster:  data   nimid=NR94975670-08724
May 19 12:19:22:737 [7824] cluster: sockClose:0000000001037070:10.27.163.135/56066
May 19 12:19:22:737 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:737 [7824] cluster: ciClose - [C07340468AFBEF0B55F4CDA8F9F39181F]
May 19 12:19:22:737 [7824] cluster: SetResourceGroupOnline(): - IN
May 19 12:19:22:737 [7824] cluster: SetResourceGroupOnline - FRHDGSP-APBCT03
May 19 12:19:22:737 [7824] cluster: SetResourceGroupOnline - Activate profile=/messages
May 19 12:19:22:737 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:737 [7824] cluster: ActivateResource - probe=cdm, profile=/messages, file=FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:19:22:737 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:22:737 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_uejumssi.pds]- IN
May 19 12:19:22:749 [7824] cluster: PdsFromFile - read 17669 bytes from FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:19:22:749 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:749 [7824] cluster: PdsFromFile Size=17669
May 19 12:19:22:749 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:749 [7824] cluster: sections        PDS_PPDS      17584 
May 19 12:19:22:749 [7824] cluster: sections[0]     PDS_PPDS         25 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          10 /messages
May 19 12:19:22:750 [7824] cluster: sections[1]     PDS_PPDS        264 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          19 /messages/CpuError
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         117 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          10 cpu_error
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:750 [7824] cluster: sections[2]     PDS_PPDS        271 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          21 /messages/CpuWarning
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         119 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          12 cpu_warning
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:750 [7824] cluster: sections[3]     PDS_PPDS        331 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuErrorProcesses
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         142 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          20 cpu_error_processes
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:750 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:750 [7824] cluster: sections[4]     PDS_PPDS        335 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          30 /messages/CpuWarningProcesses ~
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         144 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          22 cpu_warning_processes
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:750 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:750 [7824] cluster: sections[5]     PDS_PPDS        263 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuError-Ind
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         109 Individual CPU Usage for cpu($~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          14 cpu_error_ind
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:750 [7824] cluster: sections[6]     PDS_PPDS        270 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuWarning-Ind
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         111 Individual CPU Usage for cpu($~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          16 cpu_warning_ind
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:750 [7824] cluster: sections[7]     PDS_PPDS        270 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuUserError
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          15 cpu_user_error
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:750 [7824] cluster: sections[8]     PDS_PPDS        277 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuUserWarning
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          17 cpu_user_warning
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:750 [7824] cluster: sections[9]     PDS_PPDS        269 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuUserError-Ind
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         108 Individual CPU User for cpu($i~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          19 cpu_user_error_ind
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:750 [7824] cluster: sections[10]    PDS_PPDS        276 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuUserWarning-Ind
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         110 Individual CPU User for cpu($i~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          21 cpu_user_warning_ind
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:750 [7824] cluster: sections[11]    PDS_PPDS        276 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuSystemError
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          17 cpu_system_error
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:750 [7824] cluster: sections[12]    PDS_PPDS        283 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuSystemWarning
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          19 cpu_system_warning
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:750 [7824] cluster: sections[13]    PDS_PPDS        275 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuSystemError-Ind
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         110 Individual CPU System for cpu(~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          21 cpu_system_error_ind
May 19 12:19:22:750 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:750 [7824] cluster: sections[14]    PDS_PPDS        289 
May 19 12:19:22:750 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuSystemWarning-Ind~
May 19 12:19:22:750 [7824] cluster:  text            PDS_PCH         119 Individual CPU System for cpu(~
May 19 12:19:22:750 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:750 [7824] cluster:  token           PDS_PCH          23 cpu_system_warning_ind
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:751 [7824] cluster: sections[15]    PDS_PPDS        278 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIOWaitError
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          17 cpu_iowait_error
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:751 [7824] cluster: sections[16]    PDS_PPDS        285 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIOWaitWarning
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          19 cpu_iowait_warning
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:751 [7824] cluster: sections[17]    PDS_PPDS        277 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIOWaitError-Ind
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         110 Individual CPU IOWait for cpu(~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          21 cpu_iowait_error_ind
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:751 [7824] cluster: sections[18]    PDS_PPDS        284 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuIOWaitWarning-Ind~
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         112 Individual CPU IOWait for cpu(~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          23 cpu_iowait_warning_ind
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:751 [7824] cluster: sections[19]    PDS_PPDS        270 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuIdleError
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          15 cpu_idle_error
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:751 [7824] cluster: sections[20]    PDS_PPDS        277 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIdleWarning
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          17 cpu_idle_warning
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:751 [7824] cluster: sections[21]    PDS_PPDS        269 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIdleError-Ind
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         108 Individual CPU Idle for cpu($i~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          19 cpu_idle_error_ind
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:751 [7824] cluster: sections[22]    PDS_PPDS        276 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIdleWarning-Ind
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         110 Individual CPU Idle for cpu($i~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          21 cpu_idle_warning_ind
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:751 [7824] cluster: sections[23]    PDS_PPDS        223 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuMultiMaxError
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH          81 Average of single cpu (id=$max~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          20 cpu_multi_max_error
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          27 as#system.cdm.arg_sngl_cpu
May 19 12:19:22:751 [7824] cluster: sections[24]    PDS_PPDS        308 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuMultiDiffError
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         147 $check_name: Difference betwee~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          21 cpu_multi_diff_error
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.diff_highest_low~
May 19 12:19:22:751 [7824] cluster: sections[25]    PDS_PPDS        295 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          24 /messages/PagefileError
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          15 pagefile_error
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:751 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:751 [7824] cluster: sections[26]    PDS_PPDS        299 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          26 /messages/PagefileWarning
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         122 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          17 pagefile_warning
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:751 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:751 [7824] cluster: sections[27]    PDS_PPDS        264 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          22 /messages/PagingError
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         114 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          13 paging_error
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:751 [7824] cluster: sections[28]    PDS_PPDS        271 
May 19 12:19:22:751 [7824] cluster:  __section       PDS_PCH          24 /messages/PagingWarning
May 19 12:19:22:751 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:751 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:751 [7824] cluster:  token           PDS_PCH          15 paging_warning
May 19 12:19:22:751 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:752 [7824] cluster: sections[29]    PDS_PPDS        290 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          26 /messages/PhysicalWarning
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          17 physical_warning
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:752 [7824] cluster: sections[30]    PDS_PPDS        342 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          35 /messages/PhysicalWarningProce~
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         157 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          27 physical_warning_processes
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:752 [7824] cluster: sections[31]    PDS_PPDS        272 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          20 /messages/SwapError
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         125 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          11 swap_error
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:752 [7824] cluster: sections[32]    PDS_PPDS        279 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          22 /messages/SwapWarning
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         127 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          11 swap_error
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:752 [7824] cluster: sections[32]    PDS_PPDS        279 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          22 /messages/SwapWarning
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         127 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          13 swap_warning
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:752 [7824] cluster: sections[33]    PDS_PPDS        322 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          20 /messages/DiskError
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         150 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          11 disk_error
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:752 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:752 [7824] cluster: sections[34]    PDS_PPDS        326 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskWarning
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         152 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          13 disk_warning
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:752 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:752 [7824] cluster: sections[35]    PDS_PPDS        282 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          21 /messages/InodeError
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          12 inode_error
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:752 [7824] cluster: sections[36]    PDS_PPDS        289 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          23 /messages/InodeWarning
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          14 inode_warning
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:752 [7824] cluster: sections[37]    PDS_PPDS        210 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          21 /messages/DeltaError
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:752 [7824] cluster: sections[38]    PDS_PPDS        214 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          23 /messages/DeltaWarning
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:752 [7824] cluster: sections[39]    PDS_PPDS        191 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMissing
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH          49 $disk_type file system $filesy~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          13 disk_missing
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          36 as#system.cdm.local_filesys_no~
May 19 12:19:22:752 [7824] cluster: sections[40]    PDS_PPDS        185 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMounted
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH          43 Network disk $drive ($disk) is~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          13 disk_mounted
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          39 as#system.cdm.network_disk_not~
May 19 12:19:22:752 [7824] cluster: sections[41]    PDS_PPDS        186 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          26 /messages/ConnectionError
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH          44 Network connection error; $dri~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          17 connection_error
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          31 as#system.cdm.network_conn_err~
May 19 12:19:22:752 [7824] cluster: sections[42]    PDS_PPDS        275 
May 19 12:19:22:752 [7824] cluster:  __section       PDS_PCH          23 /messages/ProcQueueLen
May 19 12:19:22:752 [7824] cluster:  text            PDS_PCH         134 Average ($value_number samples~
May 19 12:19:22:752 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:752 [7824] cluster:  token           PDS_PCH          11 proc_q_len
May 19 12:19:22:752 [7824] cluster:  i18n_token      PDS_PCH          38 as#system.cdm.avrg_processor_q~
May 19 12:19:22:752 [7824] cluster: sections[43]    PDS_PPDS        201 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          20 /messages/BootAlarm
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          54 $check_name: Computer has been~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          11 boot_alarm
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          26 as#system.cdm.comp_reboot
May 19 12:19:22:753 [7824] cluster: sections[44]    PDS_PPDS        188 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          24 /messages/InternalAlarm
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          33 $check_name: $situation ($erro~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          15 internal_alarm
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          28 as#system.cdm.situation_err
May 19 12:19:22:753 [7824] cluster: sections[45]    PDS_PPDS        256 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          24 /messages/DiskRateError
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          16 disk_rate_error
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.disk_rate_above_~
May 19 12:19:22:753 [7824] cluster: sections[46]    PDS_PPDS        265 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          26 /messages/DiskRateWarning
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          18 disk_rate_warning
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          45 as#system.cdm.disk_rate_above_~
May 19 12:19:22:753 [7824] cluster: sections[47]    PDS_PPDS        274 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          31 /messages/DiskReadLatencyError~
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          24 disk_read_latency_error
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:753 [7824] cluster: sections[48]    PDS_PPDS        283 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          33 /messages/DiskReadLatencyWarni~
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          26 disk_read_latency_warning
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:753 [7824] cluster: sections[49]    PDS_PPDS        285 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          34 /messages/DiskWriteLatencyWarn~
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          27 disk_write_latency_warning
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:753 [7824] cluster: sections[50]    PDS_PPDS        276 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          32 /messages/DiskWriteLatencyErro~
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          25 disk_write_latency_error
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:753 [7824] cluster: sections[51]    PDS_PPDS        274 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          29 /messages/DiskLatencyWarning
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          21 disk_latency_warning
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:753 [7824] cluster: sections[52]    PDS_PPDS        265 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          27 /messages/DiskLatencyError
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          19 disk_latency_error
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:753 [7824] cluster: sections[53]    PDS_PPDS        251 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          23 /messages/NICRateError
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          15 nic_rate_error
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.nic_rate_above_e~
May 19 12:19:22:753 [7824] cluster: sections[54]    PDS_PPDS        260 
May 19 12:19:22:753 [7824] cluster:  __section       PDS_PCH          25 /messages/NICRateWarning
May 19 12:19:22:753 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:753 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:753 [7824] cluster:  token           PDS_PCH          17 nic_rate_warning
May 19 12:19:22:753 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:753 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.nic_rate_above_w~
May 19 12:19:22:753 [7824] cluster: sections[55]    PDS_PPDS        278 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          25 /messages/SystemMemError
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          17 system_mem_major
May 19 12:19:22:754 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.system_memory_ab~
May 19 12:19:22:754 [7824] cluster: sections[56]    PDS_PPDS        286 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          27 /messages/SystemMemWarning
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          19 system_mem_warning
May 19 12:19:22:754 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.system_memory_ab~
May 19 12:19:22:754 [7824] cluster: sections[57]    PDS_PPDS        268 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          23 /messages/UserMemError
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH          92 User memory utilization is now~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          15 user_mem_major
May 19 12:19:22:754 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.user_memory_abov~
May 19 12:19:22:754 [7824] cluster: sections[58]    PDS_PPDS        278 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          25 /messages/UserMemWarning
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH          94 User memory utilization is now~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          17 user_mem_warning
May 19 12:19:22:754 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.user_memory_abov~
May 19 12:19:22:754 [7824] cluster: sections[59]    PDS_PPDS        326 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          27 /messages/AvailableWarning
May 19 12:19:22:754 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.available_memory~
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH         126 Average ($value_number samples~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          25 available_memory_warning
May 19 12:19:22:754 [7824] cluster: sections[60]    PDS_PPDS        316 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          25 /messages/AvailableError
May 19 12:19:22:754 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          53 as#system.cdm.available_memory~
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH         124 Average ($value_number samples~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          23 available_memory_error
May 19 12:19:22:754 [7824] cluster: sections[61]    PDS_PPDS        286 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          24 /messages/PhysicalError
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          15 physical_error
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:754 [7824] cluster: sections[62]    PDS_PPDS        336 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          33 /messages/PhysicalErrorProcess~
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH         155 Average ($value_number samples~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          25 physical_error_processes
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:754 [7824] cluster: ActivateResource Size=17669
May 19 12:19:22:754 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:754 [7824] cluster: sections        PDS_PPDS      17584 
May 19 12:19:22:754 [7824] cluster: sections[0]     PDS_PPDS         25 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          10 /messages
May 19 12:19:22:754 [7824] cluster: sections[1]     PDS_PPDS        264 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          19 /messages/CpuError
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH         117 Average ($value_number samples~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          10 cpu_error
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:754 [7824] cluster: sections[2]     PDS_PPDS        271 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          21 /messages/CpuWarning
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH         119 Average ($value_number samples~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          12 cpu_warning
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:754 [7824] cluster: sections[3]     PDS_PPDS        331 
May 19 12:19:22:754 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuErrorProcesses
May 19 12:19:22:754 [7824] cluster:  text            PDS_PCH         142 Average ($value_number samples~
May 19 12:19:22:754 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:754 [7824] cluster:  token           PDS_PCH          20 cpu_error_processes
May 19 12:19:22:754 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:754 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:755 [7824] cluster: sections[4]     PDS_PPDS        335 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          30 /messages/CpuWarningProcesses ~
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         144 Average ($value_number samples~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          22 cpu_warning_processes
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:755 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:755 [7824] cluster: sections[5]     PDS_PPDS        263 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuError-Ind
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         109 Individual CPU Usage for cpu($~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          14 cpu_error_ind
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:755 [7824] cluster: sections[6]     PDS_PPDS        270 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuWarning-Ind
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         111 Individual CPU Usage for cpu($~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          16 cpu_warning_ind
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:755 [7824] cluster: sections[7]     PDS_PPDS        270 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuUserError
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          15 cpu_user_error
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:755 [7824] cluster: sections[8]     PDS_PPDS        277 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuUserWarning
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          17 cpu_user_warning
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:755 [7824] cluster: sections[9]     PDS_PPDS        269 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuUserError-Ind
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         108 Individual CPU User for cpu($i~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          19 cpu_user_error_ind
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:755 [7824] cluster: sections[10]    PDS_PPDS        276 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuUserWarning-Ind
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         110 Individual CPU User for cpu($i~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          21 cpu_user_warning_ind
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:755 [7824] cluster: sections[11]    PDS_PPDS        276 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuSystemError
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          17 cpu_system_error
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:755 [7824] cluster: sections[12]    PDS_PPDS        283 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuSystemWarning
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          19 cpu_system_warning
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:755 [7824] cluster: sections[13]    PDS_PPDS        275 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuSystemError-Ind
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         110 Individual CPU System for cpu(~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          21 cpu_system_error_ind
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:755 [7824] cluster: sections[14]    PDS_PPDS        289 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuSystemWarning-Ind~
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         119 Individual CPU System for cpu(~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          23 cpu_system_warning_ind
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:755 [7824] cluster: sections[15]    PDS_PPDS        278 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIOWaitError
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          17 cpu_iowait_error
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:755 [7824] cluster: sections[16]    PDS_PPDS        285 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIOWaitWarning
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:755 [7824] cluster:  token           PDS_PCH          19 cpu_iowait_warning
May 19 12:19:22:755 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:755 [7824] cluster: sections[17]    PDS_PPDS        277 
May 19 12:19:22:755 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIOWaitError-Ind
May 19 12:19:22:755 [7824] cluster:  text            PDS_PCH         110 Individual CPU IOWait for cpu(~
May 19 12:19:22:755 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          21 cpu_iowait_error_ind
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:756 [7824] cluster: sections[18]    PDS_PPDS        284 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuIOWaitWarning-Ind~
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         112 Individual CPU IOWait for cpu(~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          23 cpu_iowait_warning_ind
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:756 [7824] cluster: sections[19]    PDS_PPDS        270 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuIdleError
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          15 cpu_idle_error
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:756 [7824] cluster: sections[20]    PDS_PPDS        277 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIdleWarning
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          17 cpu_idle_warning
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:756 [7824] cluster: sections[21]    PDS_PPDS        269 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIdleError-Ind
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         108 Individual CPU Idle for cpu($i~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          19 cpu_idle_error_ind
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:756 [7824] cluster: sections[22]    PDS_PPDS        276 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIdleWarning-Ind
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         110 Individual CPU Idle for cpu($i~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          21 cpu_idle_warning_ind
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:756 [7824] cluster: sections[23]    PDS_PPDS        223 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuMultiMaxError
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH          81 Average of single cpu (id=$max~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          20 cpu_multi_max_error
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          27 as#system.cdm.arg_sngl_cpu
May 19 12:19:22:756 [7824] cluster: sections[24]    PDS_PPDS        308 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuMultiDiffError
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         147 $check_name: Difference betwee~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          21 cpu_multi_diff_error
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.diff_highest_low~
May 19 12:19:22:756 [7824] cluster: sections[25]    PDS_PPDS        295 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          24 /messages/PagefileError
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          15 pagefile_error
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:756 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:756 [7824] cluster: sections[26]    PDS_PPDS        299 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          26 /messages/PagefileWarning
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         122 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          17 pagefile_warning
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:756 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:756 [7824] cluster: sections[27]    PDS_PPDS        264 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          22 /messages/PagingError
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         114 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          13 paging_error
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:756 [7824] cluster: sections[28]    PDS_PPDS        271 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          24 /messages/PagingWarning
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          15 paging_warning
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:756 [7824] cluster: sections[29]    PDS_PPDS        290 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          26 /messages/PhysicalWarning
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          17 physical_warning
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:756 [7824] cluster: sections[30]    PDS_PPDS        342 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          35 /messages/PhysicalWarningProce~
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         157 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          27 physical_warning_processes
May 19 12:19:22:756 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:756 [7824] cluster: sections[31]    PDS_PPDS        272 
May 19 12:19:22:756 [7824] cluster:  __section       PDS_PCH          20 /messages/SwapError
May 19 12:19:22:756 [7824] cluster:  text            PDS_PCH         125 Average ($value_number samples~
May 19 12:19:22:756 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:756 [7824] cluster:  token           PDS_PCH          11 swap_error
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:757 [7824] cluster: sections[32]    PDS_PPDS        279 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          22 /messages/SwapWarning
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH         127 Average ($value_number samples~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          13 swap_warning
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:757 [7824] cluster: sections[33]    PDS_PPDS        322 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          20 /messages/DiskError
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH         150 Average ($value_number samples~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          11 disk_error
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:757 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:757 [7824] cluster: sections[34]    PDS_PPDS        326 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskWarning
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH         152 Average ($value_number samples~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          13 disk_warning
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:757 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:757 [7824] cluster: sections[35]    PDS_PPDS        282 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          21 /messages/InodeError
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          12 inode_error
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:757 [7824] cluster: sections[36]    PDS_PPDS        289 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          23 /messages/InodeWarning
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          14 inode_warning
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:757 [7824] cluster: sections[37]    PDS_PPDS        210 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          21 /messages/DeltaError
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:757 [7824] cluster: sections[38]    PDS_PPDS        214 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          23 /messages/DeltaWarning
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:757 [7824] cluster: sections[39]    PDS_PPDS        191 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMissing
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          49 $disk_type file system $filesy~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          13 disk_missing
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          36 as#system.cdm.local_filesys_no~
May 19 12:19:22:757 [7824] cluster: sections[40]    PDS_PPDS        185 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMounted
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          43 Network disk $drive ($disk) is~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          13 disk_mounted
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          39 as#system.cdm.network_disk_not~
May 19 12:19:22:757 [7824] cluster: sections[41]    PDS_PPDS        186 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          26 /messages/ConnectionError
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          44 Network connection error; $dri~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          17 connection_error
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          31 as#system.cdm.network_conn_err~
May 19 12:19:22:757 [7824] cluster: sections[42]    PDS_PPDS        275 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          23 /messages/ProcQueueLen
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH         134 Average ($value_number samples~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          11 proc_q_len
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          38 as#system.cdm.avrg_processor_q~
May 19 12:19:22:757 [7824] cluster: sections[43]    PDS_PPDS        201 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          20 /messages/BootAlarm
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          54 $check_name: Computer has been~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:757 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          11 boot_alarm
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          26 as#system.cdm.comp_reboot
May 19 12:19:22:757 [7824] cluster: sections[44]    PDS_PPDS        188 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          24 /messages/InternalAlarm
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          33 $check_name: $situation ($erro~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:757 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:757 [7824] cluster:  token           PDS_PCH          15 internal_alarm
May 19 12:19:22:757 [7824] cluster:  i18n_token      PDS_PCH          28 as#system.cdm.situation_err
May 19 12:19:22:757 [7824] cluster: sections[45]    PDS_PPDS        256 
May 19 12:19:22:757 [7824] cluster:  __section       PDS_PCH          24 /messages/DiskRateError
May 19 12:19:22:757 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:757 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          16 disk_rate_error
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.disk_rate_above_~
May 19 12:19:22:758 [7824] cluster: sections[46]    PDS_PPDS        265 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          26 /messages/DiskRateWarning
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          18 disk_rate_warning
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          45 as#system.cdm.disk_rate_above_~
May 19 12:19:22:758 [7824] cluster: sections[47]    PDS_PPDS        274 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          31 /messages/DiskReadLatencyError~
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          24 disk_read_latency_error
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:758 [7824] cluster: sections[48]    PDS_PPDS        283 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          33 /messages/DiskReadLatencyWarni~
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          26 disk_read_latency_warning
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:758 [7824] cluster: sections[49]    PDS_PPDS        285 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          34 /messages/DiskWriteLatencyWarn~
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          27 disk_write_latency_warning
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:758 [7824] cluster: sections[50]    PDS_PPDS        276 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          32 /messages/DiskWriteLatencyErro~
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          25 disk_write_latency_error
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:758 [7824] cluster: sections[51]    PDS_PPDS        274 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          29 /messages/DiskLatencyWarning
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          21 disk_latency_warning
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:758 [7824] cluster: sections[52]    PDS_PPDS        265 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          27 /messages/DiskLatencyError
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          19 disk_latency_error
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:758 [7824] cluster: sections[53]    PDS_PPDS        251 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          23 /messages/NICRateError
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          15 nic_rate_error
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.nic_rate_above_e~
May 19 12:19:22:758 [7824] cluster: sections[54]    PDS_PPDS        260 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          25 /messages/NICRateWarning
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          17 nic_rate_warning
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.nic_rate_above_w~
May 19 12:19:22:758 [7824] cluster: sections[55]    PDS_PPDS        278 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          25 /messages/SystemMemError
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          17 system_mem_major
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.system_memory_ab~
May 19 12:19:22:758 [7824] cluster: sections[56]    PDS_PPDS        286 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          27 /messages/SystemMemWarning
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          19 system_mem_warning
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:758 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.system_memory_ab~
May 19 12:19:22:758 [7824] cluster: sections[57]    PDS_PPDS        268 
May 19 12:19:22:758 [7824] cluster:  __section       PDS_PCH          23 /messages/UserMemError
May 19 12:19:22:758 [7824] cluster:  text            PDS_PCH          92 User memory utilization is now~
May 19 12:19:22:758 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:758 [7824] cluster:  token           PDS_PCH          15 user_mem_major
May 19 12:19:22:758 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:759 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.user_memory_abov~
May 19 12:19:22:759 [7824] cluster: sections[58]    PDS_PPDS        278 
May 19 12:19:22:759 [7824] cluster:  __section       PDS_PCH          25 /messages/UserMemWarning
May 19 12:19:22:759 [7824] cluster:  text            PDS_PCH          94 User memory utilization is now~
May 19 12:19:22:759 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:759 [7824] cluster:  token           PDS_PCH          17 user_mem_warning
May 19 12:19:22:759 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:759 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.user_memory_abov~
May 19 12:19:22:759 [7824] cluster: sections[59]    PDS_PPDS        326 
May 19 12:19:22:759 [7824] cluster:  __section       PDS_PCH          27 /messages/AvailableWarning
May 19 12:19:22:759 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:759 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.available_memory~
May 19 12:19:22:759 [7824] cluster:  text            PDS_PCH         126 Average ($value_number samples~
May 19 12:19:22:759 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:759 [7824] cluster:  token           PDS_PCH          25 available_memory_warning
May 19 12:19:22:759 [7824] cluster: sections[60]    PDS_PPDS        316 
May 19 12:19:22:759 [7824] cluster:  __section       PDS_PCH          25 /messages/AvailableError
May 19 12:19:22:759 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:759 [7824] cluster:  i18n_token      PDS_PCH          53 as#system.cdm.available_memory~
May 19 12:19:22:759 [7824] cluster:  text            PDS_PCH         124 Average ($value_number samples~
May 19 12:19:22:759 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:759 [7824] cluster:  token           PDS_PCH          23 available_memory_error
May 19 12:19:22:759 [7824] cluster: sections[61]    PDS_PPDS        286 
May 19 12:19:22:759 [7824] cluster:  __section       PDS_PCH          24 /messages/PhysicalError
May 19 12:19:22:759 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:759 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:759 [7824] cluster:  token           PDS_PCH          15 physical_error
May 19 12:19:22:759 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:759 [7824] cluster: sections[62]    PDS_PPDS        336 
May 19 12:19:22:759 [7824] cluster:  __section       PDS_PCH          33 /messages/PhysicalErrorProcess~
May 19 12:19:22:759 [7824] cluster:  text            PDS_PCH         155 Average ($value_number samples~
May 19 12:19:22:759 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:759 [7824] cluster:  token           PDS_PCH          25 physical_error_processes
May 19 12:19:22:759 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:759 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:759 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:760 [7824] cluster: PdsToSection: section[/messages]
May 19 12:19:22:760 [7824] cluster: PdsToSection - section deleted=/messages size=25
May 19 12:19:22:760 [7824] cluster: PdsToSection: section[/messages/CpuError]
May 19 12:19:22:760 [7824] cluster: PdsToSection - section deleted=/messages/CpuError size=264
May 19 12:19:22:760 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:760 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=level, val=major
May 19 12:19:22:760 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=token, val=cpu_error
May 19 12:19:22:760 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_err_threshold
May 19 12:19:22:760 [7824] cluster: PdsToSection: section[/messages/CpuWarning]
May 19 12:19:22:760 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarning size=271
May 19 12:19:22:760 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:760 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=level, val=minor
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=token, val=cpu_warning
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_warn_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuErrorProcesses]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuErrorProcesses size=331
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the error threshold ($value_limit$unit).Top Processes $processes
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=level, val=critical
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=token, val=cpu_error_processes
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_err_threshold_proc
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=subsystem, val=
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuWarningProcesses]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarningProcesses size=335
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the warning threshold ($value_limit$unit).Top Processes $processes
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=level, val=major
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=token, val=cpu_warning_processes
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_warn_threshold_proc
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=subsystem, val=
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuError-Ind]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuError-Ind size=263
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=text, val=Individual CPU Usage for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=level, val=major
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=token, val=cpu_error_ind
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=i18n_token, val=as#system.cdm.ind_cpu_usage_above_err_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuWarning-Ind]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarning-Ind size=270
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=text, val=Individual CPU Usage for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=level, val=minor
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=token, val=cpu_warning_ind
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=i18n_token, val=as#system.cdm.ind_cpu_usage_above_warn_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuUserError]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserError size=270
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=text, val=Average ($value_number samples) user cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=level, val=major
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=token, val=cpu_user_error
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=i18n_token, val=as#system.cdm.avrg_usr_cpu_above_err_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuUserWarning]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserWarning size=277
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=text, val=Average ($value_number samples) user cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=level, val=minor
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=token, val=cpu_user_warning
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=i18n_token, val=as#system.cdm.avrg_usr_cpu_above_warn_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuUserError-Ind]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserError-Ind size=269
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=text, val=Individual CPU User for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=level, val=major
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=token, val=cpu_user_error_ind
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=i18n_token, val=as#system.cdm.ind_usr_cpu_above_err_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuUserWarning-Ind]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserWarning-Ind size=276
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=text, val=Individual CPU User for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=level, val=minor
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=token, val=cpu_user_warning_ind
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=i18n_token, val=as#system.cdm.ind_usr_cpu_above_warn_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuSystemError]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemError size=276
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=text, val=Average ($value_number samples) system cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=level, val=major
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=token, val=cpu_system_error
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=i18n_token, val=as#system.cdm.avrg_sys_cpu_above_err_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuSystemWarning]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemWarning size=283
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=text, val=Average ($value_number samples) system cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=level, val=minor
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=token, val=cpu_system_warning
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=i18n_token, val=as#system.cdm.avrg_sys_cpu_above_warn_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuSystemError-Ind]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemError-Ind size=275
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=text, val=Individual CPU System for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=level, val=major
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=token, val=cpu_system_error_ind
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=i18n_token, val=as#system.cdm.ind_cpu_sys_above_err_threshold
May 19 12:19:22:761 [7824] cluster: PdsToSection: section[/messages/CpuSystemWarning-Ind]
May 19 12:19:22:761 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemWarning-Ind size=289
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=text, val=Individual CPU System for cpu($id) is now is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=level, val=minor
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=token, val=cpu_system_warning_ind
May 19 12:19:22:761 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=i18n_token, val=as#system.cdm.ind_cpu_sys_above_warn_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitError]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitError size=278
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=text, val=Average ($value_number samples) IOWait cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=level, val=major
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=token, val=cpu_iowait_error
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=i18n_token, val=as#system.cdm.avrg_iowaitcpu_above_err_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitWarning]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitWarning size=285
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=text, val=Average ($value_number samples) IOWait cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=level, val=minor
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=token, val=cpu_iowait_warning
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=i18n_token, val=as#system.cdm.avrg_iowaitcpu_above_warn_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitError-Ind]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitError-Ind size=277
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=text, val=Individual CPU IOWait for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=level, val=major
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=token, val=cpu_iowait_error_ind
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=i18n_token, val=as#system.cdm.ind_iowaitcpu_above_err_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitWarning-Ind]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=text, val=Individual CPU IOWait for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=level, val=minor
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=token, val=cpu_iowait_warning_ind
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=i18n_token, val=as#system.cdm.ind_iowaitcpu_above_warn_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIdleError]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleError size=270
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=text, val=Average ($value_number samples) Idle cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=level, val=major
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=token, val=cpu_idle_error
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=i18n_token, val=as#system.cdm.avrg_idlecpu_above_err_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIdleWarning]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleWarning size=277
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=text, val=Average ($value_number samples) Idle cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=level, val=minor
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=token, val=cpu_idle_warning
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=i18n_token, val=as#system.cdm.avrg_idlecpu_above_warn_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIdleError-Ind]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleError-Ind size=269
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=text, val=Individual CPU Idle for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=level, val=major
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=token, val=cpu_idle_error_ind
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=i18n_token, val=as#system.cdm.ind_idlecpu_above_err_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuIdleWarning-Ind]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleWarning-Ind size=276
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=text, val=Individual CPU Idle for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=level, val=minor
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=token, val=cpu_idle_warning_ind
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=i18n_token, val=as#system.cdm.ind_idlecpu_above_warn_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuMultiMaxError]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuMultiMaxError size=223
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=text, val=Average of single cpu (id=$max_processor_index)=$value$unit >= $value_limit$unit
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=level, val=minor
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=token, val=cpu_multi_max_error
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=i18n_token, val=as#system.cdm.arg_sngl_cpu
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/CpuMultiDiffError]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/CpuMultiDiffError size=308
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=text, val=$check_name: Difference between highest and lowest processor load (id=$max_processor_index, $min_processor_index)=$value$unit >= $value_limit$unit
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=level, val=minor
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=token, val=cpu_multi_diff_error
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=i18n_token, val=as#system.cdm.diff_highest_lowest_cpu_load
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/PagefileError]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/PagefileError size=295
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=text, val=Average ($value_number samples) memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=level, val=critical
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=token, val=pagefile_error
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=i18n_token, val=as#system.cdm.avrg_mem_usage_above_err_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=subsystem, val=
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/PagefileWarning]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/PagefileWarning size=299
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=text, val=Average ($value_number samples) memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=level, val=major
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=token, val=pagefile_warning
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=i18n_token, val=as#system.cdm.avrg_mem_usage_above_warn_threshold
May 19 12:19:22:762 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=subsystem, val=
May 19 12:19:22:762 [7824] cluster: PdsToSection: section[/messages/PagingError]
May 19 12:19:22:762 [7824] cluster: PdsToSection - section deleted=/messages/PagingError size=264
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=text, val=Average ($value_number samples) paging is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=level, val=major
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=token, val=paging_error
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=i18n_token, val=as#system.cdm.avrg_paging_above_err_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/PagingWarning]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/PagingWarning size=271
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/PagingWarning size=271
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=text, val=Average ($value_number samples) paging is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=level, val=minor
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=token, val=paging_warning
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=i18n_token, val=as#system.cdm.avrg_paging_above_warn_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/PhysicalWarning]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalWarning size=290
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=level, val=minor
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=token, val=physical_warning
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=i18n_token, val=as#system.cdm.avrg_phymem_above_warn_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/PhysicalWarningProcesses]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalWarningProcesses size=342
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit). Top Processes $processes
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=level, val=warning
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=token, val=physical_warning_processes
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=i18n_token, val=as#system.cdm.avrg_phymem_above_warn_threshold_proc
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/SwapError]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/SwapError size=272
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=text, val=Average ($value_number samples) swap memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=level, val=major
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=token, val=swap_error
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=i18n_token, val=as#system.cdm.avrg_swapmem_above_err_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/SwapWarning]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/SwapWarning size=279
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=text, val=Average ($value_number samples) swap memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=level, val=minor
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=token, val=swap_warning
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=i18n_token, val=as#system.cdm.avrg_swapmem_above_warn_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/DiskError]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/DiskError size=322
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=text, val=Average ($value_number samples) disk free on $drive is now $value$unit, which is <= error threshold ($value_limit$unit) out of total size $size_gb GB
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=level, val=critical
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=token, val=disk_error
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=i18n_token, val=as#system.cdm.avrg_drive_diskfree_below_err_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=subsystem, val=
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/DiskWarning]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/DiskWarning size=326
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=text, val=Average ($value_number samples) disk free on $drive is now $value$unit, which is <= warning threshold ($value_limit$unit) out of total size $size_gb GB
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=level, val=major
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=token, val=disk_warning
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=i18n_token, val=as#system.cdm.avrg_drive_diskfree_below_warn_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=subsystem, val=
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/InodeError]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/InodeError size=282
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=text, val=Average ($value_number samples) inodes free on $drive is now $value$unit, which is below the error threshold ($value_limit$unit)
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=level, val=major
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=token, val=inode_error
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=i18n_token, val=as#system.cdm.avrg_free_inodes_below_err_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/InodeWarning]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/InodeWarning size=289
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=text, val=Average ($value_number samples) inodes free on $drive is now $value$unit, which is below the warning threshold ($value_limit$unit)
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=level, val=minor
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=token, val=inode_warning
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=i18n_token, val=as#system.cdm.avrg_free_inodes_below_warn_threshold
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/DeltaError]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/DeltaError size=210
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=text, val=$check_name: Disk usage change on $filesys, changed by $value $unit
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=level, val=minor
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=token, val=disk_delta
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=i18n_token, val=as#system.cdm.disk_usage_changed_by_value
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/DeltaWarning]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/DeltaWarning size=214
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=text, val=$check_name: Disk usage change on $filesys, changed by $value $unit
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=level, val=warning
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=token, val=disk_delta
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=i18n_token, val=as#system.cdm.disk_usage_changed_by_value
May 19 12:19:22:763 [7824] cluster: PdsToSection: section[/messages/DiskMissing]
May 19 12:19:22:763 [7824] cluster: PdsToSection - section deleted=/messages/DiskMissing size=191
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=text, val=$disk_type file system $filesys is not available
May 19 12:19:22:763 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=level, val=critical
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=token, val=disk_missing
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=i18n_token, val=as#system.cdm.local_filesys_not_avl
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/DiskMounted]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/DiskMounted size=185
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=text, val=Network disk $drive ($disk) is not mounted
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=level, val=major
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=token, val=disk_mounted
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=i18n_token, val=as#system.cdm.network_disk_not_mounted
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/ConnectionError]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/ConnectionError size=186
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=text, val=Network connection error; $drive $netstatus
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=level, val=major
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=token, val=connection_error
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=i18n_token, val=as#system.cdm.network_conn_err
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/ProcQueueLen]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/ProcQueueLen size=275
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=text, val=Average ($value_number samples) processor queue length is $value$unit, which is >= $value_limit$unit. Last value is $value_last$unit.
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=level, val=minor
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=token, val=proc_q_len
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=i18n_token, val=as#system.cdm.avrg_processor_q_length
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/BootAlarm]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/BootAlarm size=201
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=text, val=$check_name: Computer has been rebooted at $boot_time
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=level, val=warning
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=subsystem, val=1.1.1
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=token, val=boot_alarm
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=i18n_token, val=as#system.cdm.comp_reboot
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/InternalAlarm]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/InternalAlarm size=188
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=text, val=$check_name: $situation ($error)
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=level, val=minor
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=subsystem, val=1.1.1
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=token, val=internal_alarm
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=i18n_token, val=as#system.cdm.situation_err
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/DiskRateError]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/DiskRateError size=256
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=level, val=major
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=token, val=disk_rate_error
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=subsystem, val=1.1.1.1
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=i18n_token, val=as#system.cdm.disk_rate_above_err_threshold
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/DiskRateWarning]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/DiskRateWarning size=265
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=level, val=warning
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=token, val=disk_rate_warning
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=i18n_token, val=as#system.cdm.disk_rate_above_warn_threshold
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/DiskReadLatencyError]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/DiskReadLatencyError size=274
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=level, val=major
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=token, val=disk_read_latency_error
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/DiskReadLatencyWarning]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/DiskReadLatencyWarning size=283
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=level, val=warning
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=token, val=disk_read_latency_warning
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/DiskWriteLatencyWarning]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/DiskWriteLatencyWarning size=285
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=level, val=warning
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=token, val=disk_write_latency_warning
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:22:764 [7824] cluster: PdsToSection: section[/messages/DiskWriteLatencyError]
May 19 12:19:22:764 [7824] cluster: PdsToSection - section deleted=/messages/DiskWriteLatencyError size=276
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=level, val=major
May 19 12:19:22:764 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=token, val=disk_write_latency_error
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/DiskLatencyWarning]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/DiskLatencyWarning size=274
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=level, val=warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=token, val=disk_latency_warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/DiskLatencyError]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/DiskLatencyError size=265
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=level, val=major
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=token, val=disk_latency_error
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/NICRateError]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/NICRateError size=251
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=level, val=major
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=token, val=nic_rate_error
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=subsystem, val=1.1.3
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=i18n_token, val=as#system.cdm.nic_rate_above_err_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/NICRateWarning]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/NICRateWarning size=260
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=level, val=warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=token, val=nic_rate_warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=subsystem, val=1.1.3
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=i18n_token, val=as#system.cdm.nic_rate_above_warn_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/SystemMemError]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/SystemMemError size=278
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=text, val=System memory utilization is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=level, val=major
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=token, val=system_mem_major
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=subsystem, val=1.1.1.2
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=i18n_token, val=as#system.cdm.system_memory_above_error_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/SystemMemWarning]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/SystemMemWarning size=286
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=text, val=System memory utilization is now $value$unit, which is >= warning threshold ($value_limit$unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=level, val=warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=token, val=system_mem_warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=subsystem, val=1.1.1.2
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=i18n_token, val=as#system.cdm.system_memory_above_warning_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/UserMemError]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/UserMemError size=268
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=text, val=User memory utilization is now $value$unit, which is >= error threshold ($value_limit$unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=level, val=major
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=token, val=user_mem_major
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=subsystem, val=1.1.1.2
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=i18n_token, val=as#system.cdm.user_memory_above_error_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/UserMemWarning]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/UserMemWarning size=278
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=text, val=User memory utilization is now $value$unit, which is >= warning threshold ($value_limit$unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=level, val=warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=token, val=user_mem_warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=subsystem, val=1.1.1.2
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=i18n_token, val=as#system.cdm.user_memory_above_warning_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/AvailableWarning]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/AvailableWarning size=326
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=subsystem, val=1.1.1.2
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=i18n_token, val=as#system.cdm.available_memory_below_warning_threshold
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=text, val=Average ($value_number samples) available memory is now $value$unit, which is below the warning threshold ($value_limit$unit)
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=level, val=warning
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=token, val=available_memory_warning
May 19 12:19:22:765 [7824] cluster: PdsToSection: section[/messages/AvailableError]
May 19 12:19:22:765 [7824] cluster: PdsToSection - section deleted=/messages/AvailableError size=316
May 19 12:19:22:765 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=subsystem, val=1.1.1.2
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=i18n_token, val=as#system.cdm.available_memory_below_error_threshold
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=text, val=Average ($value_number samples) available memory is now $value$unit, which is below the error threshold ($value_limit$unit)
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=level, val=major
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=token, val=available_memory_error
May 19 12:19:22:766 [7824] cluster: PdsToSection: section[/messages/PhysicalError]
May 19 12:19:22:766 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalError size=286
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=level, val=critical
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=token, val=physical_error
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=i18n_token, val=as#system.cdm.avrg_phymem_above_err_threshold
May 19 12:19:22:766 [7824] cluster: PdsToSection: section[/messages/PhysicalErrorProcesses]
May 19 12:19:22:766 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalErrorProcesses size=336
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the error threshold ($value_limit$unit). Top Processes $processes
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=level, val=critical
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=token, val=physical_error_processes
May 19 12:19:22:766 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=i18n_token, val=as#system.cdm.avrg_phymem_above_err_threshold_proc
May 19 12:19:22:768 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:768 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:768 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:768 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:22:769 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:769 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:769 [7824] cluster: SetResourceGroupOnline - Activate profile=/cluster/FRHDGSP-APBCT03/disk
May 19 12:19:22:769 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:769 [7824] cluster: ActivateResource - probe=cdm, profile=/cluster/FRHDGSP-APBCT03/disk, file=FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:19:22:769 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:22:769 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_lvpdvvfg.pds]- IN
May 19 12:19:22:782 [7824] cluster: PdsFromFile - read 4582 bytes from FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:19:22:782 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:782 [7824] cluster: PdsFromFile Size=4582
May 19 12:19:22:782 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:782 [7824] cluster: sections        PDS_PPDS       4497 
May 19 12:19:22:782 [7824] cluster: sections[0]     PDS_PPDS         45 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          30 /cluster/FRHDGSP-APBCT03/disk ~
May 19 12:19:22:782 [7824] cluster: sections[1]     PDS_PPDS         51 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          36 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster: sections[2]     PDS_PPDS         57 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          42 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster: sections[3]     PDS_PPDS        484 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  description     PDS_PCH          16 File system E:\
May 19 12:19:22:782 [7824] cluster:  disk            PDS_PCH           9 DataGTBC
May 19 12:19:22:782 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:782 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:782 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:782 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:782 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:782 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:782 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:782 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:782 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:782 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:782 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:782 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:782 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:782 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:782 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:22:782 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:782 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:782 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:783 [7824] cluster: sections[11]    PDS_PPDS        487 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  description     PDS_PCH          16 File system F:\
May 19 12:19:22:783 [7824] cluster:  disk            PDS_PCH          11 backupGTBC
May 19 12:19:22:783 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:783 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:783 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster: sections[12]    PDS_PPDS        122 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:783 [7824] cluster: sections[13]    PDS_PPDS        126 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:783 [7824] cluster: sections[14]    PDS_PPDS        128 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:783 [7824] cluster: sections[15]    PDS_PPDS        132 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:783 [7824] cluster: sections[16]    PDS_PPDS        109 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:783 [7824] cluster: sections[17]    PDS_PPDS        129 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:783 [7824] cluster: sections[18]    PDS_PPDS        131 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:783 [7824] cluster: sections[19]    PDS_PPDS        485 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  description     PDS_PCH          16 File system H:\
May 19 12:19:22:783 [7824] cluster:  disk            PDS_PCH           9 LogsGTBC
May 19 12:19:22:783 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:783 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_disk_free_perc PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:783 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster: sections[20]    PDS_PPDS        122 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:783 [7824] cluster: sections[21]    PDS_PPDS        126 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:783 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:783 [7824] cluster: sections[22]    PDS_PPDS        128 
May 19 12:19:22:783 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:783 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:783 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:784 [7824] cluster: sections[23]    PDS_PPDS        132 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:784 [7824] cluster: sections[24]    PDS_PPDS        109 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:784 [7824] cluster: sections[25]    PDS_PPDS        129 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:784 [7824] cluster: sections[26]    PDS_PPDS        131 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:784 [7824] cluster: ActivateResource Size=4582
May 19 12:19:22:784 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:784 [7824] cluster: sections        PDS_PPDS       4497 
May 19 12:19:22:784 [7824] cluster: sections[0]     PDS_PPDS         45 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          30 /cluster/FRHDGSP-APBCT03/disk ~
May 19 12:19:22:784 [7824] cluster: sections[1]     PDS_PPDS         51 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          36 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster: sections[2]     PDS_PPDS         57 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          42 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster: sections[3]     PDS_PPDS        484 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  description     PDS_PCH          16 File system E:\
May 19 12:19:22:784 [7824] cluster:  disk            PDS_PCH           9 DataGTBC
May 19 12:19:22:784 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:784 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:784 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:784 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:784 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:784 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:784 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:784 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:22:784 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:784 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:784 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:784 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:784 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:785 [7824] cluster: sections[11]    PDS_PPDS        487 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  description     PDS_PCH          16 File system F:\
May 19 12:19:22:785 [7824] cluster:  disk            PDS_PCH          11 backupGTBC
May 19 12:19:22:785 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:785 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:785 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster: sections[12]    PDS_PPDS        122 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:785 [7824] cluster: sections[13]    PDS_PPDS        126 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:785 [7824] cluster: sections[14]    PDS_PPDS        128 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:785 [7824] cluster: sections[15]    PDS_PPDS        132 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:785 [7824] cluster: sections[16]    PDS_PPDS        109 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:785 [7824] cluster: sections[17]    PDS_PPDS        129 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:785 [7824] cluster: sections[18]    PDS_PPDS        131 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:785 [7824] cluster: sections[19]    PDS_PPDS        485 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  description     PDS_PCH          16 File system H:\
May 19 12:19:22:785 [7824] cluster:  disk            PDS_PCH           9 LogsGTBC
May 19 12:19:22:785 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:785 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_disk_free_perc PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:785 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:785 [7824] cluster: sections[20]    PDS_PPDS        122 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:785 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:785 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:785 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:785 [7824] cluster: sections[21]    PDS_PPDS        126 
May 19 12:19:22:785 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:786 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:786 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:786 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:786 [7824] cluster: sections[22]    PDS_PPDS        128 
May 19 12:19:22:786 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:786 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:786 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:786 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:786 [7824] cluster: sections[23]    PDS_PPDS        132 
May 19 12:19:22:786 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:786 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:786 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:786 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:786 [7824] cluster: sections[24]    PDS_PPDS        109 
May 19 12:19:22:786 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:786 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:786 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:786 [7824] cluster: sections[25]    PDS_PPDS        129 
May 19 12:19:22:786 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:786 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:786 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:786 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:786 [7824] cluster: sections[26]    PDS_PPDS        131 
May 19 12:19:22:786 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT03/disk/~
May 19 12:19:22:786 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:786 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:786 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:786 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:786 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:787 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk]
May 19 12:19:22:787 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk size=45
May 19 12:19:22:787 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm]
May 19 12:19:22:787 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm size=51
May 19 12:19:22:787 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed]
May 19 12:19:22:787 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed size=57
May 19 12:19:22:787 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\]
May 19 12:19:22:787 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ size=484
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=active, val=yes
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=description, val=File system E:\
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=disk, val=DataGTBC
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=file_system_type, val=NTFS
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=percent, val=yes
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_disk_usage, val=no
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_disk_free, val=no
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_disk_free_perc, val=no
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_disk_total_size, val=no
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=inode_percent, val=yes
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_inode_usage, val=no
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_inode_usage_perc, val=no
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=delta_percent, val=no
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=delta_calculate_all, val=yes
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=delta_type, val=both
May 19 12:19:22:787 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_disk_delta, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ key=qos_disk_delta_perc, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/error]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/error size=122
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/error key=active, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/error key=threshold, val=10
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/error key=message, val=DiskError
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning size=126
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning key=active, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning key=threshold, val=15
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning key=message, val=DiskWarning
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error size=128
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error key=active, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error key=threshold, val=10
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error key=message, val=InodeError
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning size=132
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning key=active, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning key=threshold, val=20
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning key=message, val=InodeWarning
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/missing]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/missing size=109
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/missing key=active, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/missing key=message, val=DiskMissing
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_error]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_error size=129
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_error key=active, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_error key=threshold, val=200
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_error key=message, val=DeltaError
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_warning]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_warning size=131
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_warning key=active, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_warning key=threshold, val=8
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ size=487
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=active, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=description, val=File system F:\
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=disk, val=backupGTBC
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=file_system_type, val=NTFS
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=percent, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_disk_usage, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_disk_free, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_disk_free_perc, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_disk_total_size, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=inode_percent, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_inode_usage, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_inode_usage_perc, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=delta_percent, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=delta_calculate_all, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=delta_type, val=both
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_disk_delta, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ key=qos_disk_delta_perc, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/error]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/error size=122
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/error key=active, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/error key=threshold, val=10
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/error key=message, val=DiskError
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/warning]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/warning size=126
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/warning key=active, val=yes
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/warning key=threshold, val=15
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/warning key=message, val=DiskWarning
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_error]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_error size=128
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_error key=active, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_error key=threshold, val=10
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_error key=message, val=InodeError
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_warning]
May 19 12:19:22:788 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_warning size=132
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_warning key=active, val=no
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_warning key=threshold, val=20
May 19 12:19:22:788 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_warning key=message, val=InodeWarning
May 19 12:19:22:788 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/missing]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/missing size=109
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/missing key=active, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/missing key=message, val=DiskMissing
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_error]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_error size=129
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_error key=active, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_error key=threshold, val=200
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_error key=message, val=DeltaError
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_warning]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_warning size=131
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_warning key=active, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_warning key=threshold, val=8
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ size=485
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=active, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=description, val=File system H:\
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=disk, val=LogsGTBC
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=file_system_type, val=NTFS
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=percent, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_disk_usage, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_disk_free, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_disk_free_perc, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_disk_total_size, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=inode_percent, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_inode_usage, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_inode_usage_perc, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=delta_percent, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=delta_calculate_all, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_inode_usage_perc, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=delta_percent, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=delta_calculate_all, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=delta_type, val=both
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_disk_delta, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ key=qos_disk_delta_perc, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/error]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/error size=122
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/error key=active, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/error key=threshold, val=10
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/error key=message, val=DiskError
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/warning]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/warning size=126
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/warning key=active, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/warning key=threshold, val=15
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/warning key=message, val=DiskWarning
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_error]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_error size=128
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_error key=active, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_error key=threshold, val=10
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_error key=message, val=InodeError
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_warning]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_warning size=132
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_warning key=active, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_warning key=threshold, val=20
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_warning key=message, val=InodeWarning
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/missing]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/missing size=109
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/missing key=active, val=yes
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/missing key=message, val=DiskMissing
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_error]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_error size=129
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_error key=active, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_error key=threshold, val=200
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_error key=message, val=DeltaError
May 19 12:19:22:789 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_warning]
May 19 12:19:22:789 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_warning size=131
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_warning key=active, val=no
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_warning key=threshold, val=8
May 19 12:19:22:789 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:22:792 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:792 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:792 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:792 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:22:792 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:792 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:792 [7824] cluster: SetResourceGroupOnline - Activate profile=/connections
May 19 12:19:22:792 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:792 [7824] cluster: ActivateResource - probe=sqlserver, profile=/connections, file=FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:19:22:792 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/database/sqlserver\sqlserver_monitor.cfg
May 19 12:19:22:792 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds]- IN
May 19 12:19:22:801 [7824] cluster: PdsFromFile - read 974 bytes from FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:19:22:801 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:801 [7824] cluster: PdsFromFile Size=974
May 19 12:19:22:801 [7824] cluster: __file          PDS_PCH          73 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:801 [7824] cluster: sections        PDS_PPDS        867 
May 19 12:19:22:801 [7824] cluster: sections[0]     PDS_PPDS         28 
May 19 12:19:22:801 [7824] cluster:  __section       PDS_PCH          13 /connections
May 19 12:19:22:801 [7824] cluster: sections[1]     PDS_PPDS        376 
May 19 12:19:22:801 [7824] cluster:  __section       PDS_PCH          41 /connections/frhdgsp-apbct30\A~
May 19 12:19:22:801 [7824] cluster:  user            PDS_PCH          15 SPFREPSQLSup01
May 19 12:19:22:801 [7824] cluster:  password        PDS_PCH          25 FP+MpvgNCxvBsZ28WYXDcA==
May 19 12:19:22:801 [7824] cluster:  auto_domain     PDS_PCH           3 no
May 19 12:19:22:801 [7824] cluster:  description     PDS_PCH           1 
May 19 12:19:22:801 [7824] cluster:  conn_string     PDS_PCH          28 frhdgsp-apbct30\APBCT100PPI
May 19 12:19:22:801 [7824] cluster:  retry           PDS_PCH           2 0
May 19 12:19:22:801 [7824] cluster:  retry_delay     PDS_PCH           7 30 sec
May 19 12:19:22:801 [7824] cluster:  winauth         PDS_PCH           2 0
May 19 12:19:22:801 [7824] cluster:  encryption      PDS_PCH           3 no
May 19 12:19:22:801 [7824] cluster:  enable_CrossDomain_conn PDS_PCH           3 no
May 19 12:19:22:801 [7824] cluster:  timeout         PDS_PCH           6 5 sec
May 19 12:19:22:801 [7824] cluster:  monitor_AlwaysOn PDS_PCH           3 no
May 19 12:19:22:801 [7824] cluster:  is_AlwaysOn     PDS_PCH           1 
May 19 12:19:22:801 [7824] cluster:  tls_enable      PDS_PCH           3 no
May 19 12:19:22:801 [7824] cluster: sections[2]     PDS_PPDS        221 
May 19 12:19:22:801 [7824] cluster:  __section       PDS_PCH          25 /connections/sample_conn
May 19 12:19:22:801 [7824] cluster:  description     PDS_PCH          18 sample connection
May 19 12:19:22:801 [7824] cluster:  user            PDS_PCH           8 user_id
May 19 12:19:22:801 [7824] cluster:  password        PDS_PCH           1 
May 19 12:19:22:801 [7824] cluster:  conn_string     PDS_PCH          14 sample_server
May 19 12:19:22:801 [7824] cluster:  winauth         PDS_PCH           2 0
May 19 12:19:22:801 [7824] cluster:  encryption      PDS_PCH           3 no
May 19 12:19:22:801 [7824] cluster:  retry           PDS_PCH           2 2
May 19 12:19:22:802 [7824] cluster:  retry_delay     PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster:  timeout         PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster: sections[3]     PDS_PPDS        207 
May 19 12:19:22:802 [7824] cluster:  __section       PDS_PCH          22 /connections/w2smssql
May 19 12:19:22:802 [7824] cluster:  description     PDS_PCH          18 sample connection
May 19 12:19:22:802 [7824] cluster:  user            PDS_PCH           3 sa
May 19 12:19:22:802 [7824] cluster:  password        PDS_PCH           1 
May 19 12:19:22:802 [7824] cluster:  conn_string     PDS_PCH           9 w2smssql
May 19 12:19:22:802 [7824] cluster:  winauth         PDS_PCH           2 0
May 19 12:19:22:802 [7824] cluster:  encryption      PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster:  retry           PDS_PCH           2 2
May 19 12:19:22:802 [7824] cluster:  retry_delay     PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster:  timeout         PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster: ActivateResource Size=974
May 19 12:19:22:802 [7824] cluster: __file          PDS_PCH          73 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:802 [7824] cluster: sections        PDS_PPDS        867 
May 19 12:19:22:802 [7824] cluster: sections[0]     PDS_PPDS         28 
May 19 12:19:22:802 [7824] cluster:  __section       PDS_PCH          13 /connections
May 19 12:19:22:802 [7824] cluster: sections[1]     PDS_PPDS        376 
May 19 12:19:22:802 [7824] cluster:  __section       PDS_PCH          41 /connections/frhdgsp-apbct30\A~
May 19 12:19:22:802 [7824] cluster:  user            PDS_PCH          15 SPFREPSQLSup01
May 19 12:19:22:802 [7824] cluster:  password        PDS_PCH          25 FP+MpvgNCxvBsZ28WYXDcA==
May 19 12:19:22:802 [7824] cluster:  auto_domain     PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster:  description     PDS_PCH           1 
May 19 12:19:22:802 [7824] cluster:  conn_string     PDS_PCH          28 frhdgsp-apbct30\APBCT100PPI
May 19 12:19:22:802 [7824] cluster:  retry           PDS_PCH           2 0
May 19 12:19:22:802 [7824] cluster:  retry_delay     PDS_PCH           7 30 sec
May 19 12:19:22:802 [7824] cluster:  winauth         PDS_PCH           2 0
May 19 12:19:22:802 [7824] cluster:  encryption      PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster:  enable_CrossDomain_conn PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster:  timeout         PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster:  monitor_AlwaysOn PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster:  is_AlwaysOn     PDS_PCH           1 
May 19 12:19:22:802 [7824] cluster:  tls_enable      PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster: sections[2]     PDS_PPDS        221 
May 19 12:19:22:802 [7824] cluster:  __section       PDS_PCH          25 /connections/sample_conn
May 19 12:19:22:802 [7824] cluster:  description     PDS_PCH          18 sample connection
May 19 12:19:22:802 [7824] cluster:  user            PDS_PCH           8 user_id
May 19 12:19:22:802 [7824] cluster:  password        PDS_PCH           1 
May 19 12:19:22:802 [7824] cluster:  conn_string     PDS_PCH          14 sample_server
May 19 12:19:22:802 [7824] cluster:  winauth         PDS_PCH           2 0
May 19 12:19:22:802 [7824] cluster:  encryption      PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster:  retry           PDS_PCH           2 2
May 19 12:19:22:802 [7824] cluster:  retry_delay     PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster:  timeout         PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster: sections[3]     PDS_PPDS        207 
May 19 12:19:22:802 [7824] cluster:  __section       PDS_PCH          22 /connections/w2smssql
May 19 12:19:22:802 [7824] cluster:  description     PDS_PCH          18 sample connection
May 19 12:19:22:802 [7824] cluster:  user            PDS_PCH           3 sa
May 19 12:19:22:802 [7824] cluster:  password        PDS_PCH           1 
May 19 12:19:22:802 [7824] cluster:  conn_string     PDS_PCH           9 w2smssql
May 19 12:19:22:802 [7824] cluster:  winauth         PDS_PCH           2 0
May 19 12:19:22:802 [7824] cluster:  encryption      PDS_PCH           3 no
May 19 12:19:22:802 [7824] cluster:  retry           PDS_PCH           2 2
May 19 12:19:22:802 [7824] cluster:  retry_delay     PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster:  timeout         PDS_PCH           6 5 sec
May 19 12:19:22:802 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:802 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:814 [7824] cluster: PdsToSection: section[/connections]
May 19 12:19:22:814 [7824] cluster: PdsToSection - section deleted=/connections size=28
May 19 12:19:22:814 [7824] cluster: PdsToSection: section[/connections/frhdgsp-apbct30\APBCT100PPI]
May 19 12:19:22:814 [7824] cluster: PdsToSection - section deleted=/connections/frhdgsp-apbct30\APBCT100PPI size=376
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=user, val=SPFREPSQLSup01
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=password, val=FP+MpvgNCxvBsZ28WYXDcA==
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=auto_domain, val=no
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=description, val=
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=conn_string, val=frhdgsp-apbct30\APBCT100PPI
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=retry, val=0
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=retry_delay, val=30 sec
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=winauth, val=0
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=encryption, val=no
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=enable_CrossDomain_conn, val=no
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=timeout, val=5 sec
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=monitor_AlwaysOn, val=no
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=is_AlwaysOn, val=
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/frhdgsp-apbct30\APBCT100PPI key=tls_enable, val=no
May 19 12:19:22:814 [7824] cluster: PdsToSection: section[/connections/sample_conn]
May 19 12:19:22:814 [7824] cluster: PdsToSection - section deleted=/connections/sample_conn size=221
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=description, val=sample connection
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=user, val=user_id
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=password, val=
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=conn_string, val=sample_server
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=winauth, val=0
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=encryption, val=no
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=retry, val=2
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=retry_delay, val=5 sec
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/sample_conn key=timeout, val=5 sec
May 19 12:19:22:814 [7824] cluster: PdsToSection: section[/connections/w2smssql]
May 19 12:19:22:814 [7824] cluster: PdsToSection - section deleted=/connections/w2smssql size=207
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=description, val=sample connection
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=user, val=sa
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=password, val=
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=conn_string, val=w2smssql
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=winauth, val=0
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=encryption, val=no
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=retry, val=2
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=retry_delay, val=5 sec
May 19 12:19:22:814 [7824] cluster: PdsToSection - writing to cfg.. section=/connections/w2smssql key=timeout, val=5 sec
May 19 12:19:22:827 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:827 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:827 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:827 [7824] cluster: ProbeInfoSetRestart - probe[sqlserver].. marking restart flag
May 19 12:19:22:827 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:827 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:827 [7824] cluster: SetResourceGroupOnline - Activate profile=/profiles/frhdgsp-apbct30\APBCT100PPI
May 19 12:19:22:827 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:827 [7824] cluster: ActivateResource - probe=sqlserver, profile=/profiles/frhdgsp-apbct30\APBCT100PPI, file=FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:19:22:827 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/database/sqlserver\sqlserver_monitor.cfg
May 19 12:19:22:827 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds]- IN
May 19 12:19:22:836 [7824] cluster: PdsFromFile - read 618 bytes from FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:19:22:836 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:836 [7824] cluster: PdsFromFile Size=618
May 19 12:19:22:836 [7824] cluster: __file          PDS_PCH          73 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:836 [7824] cluster: sections        PDS_PPDS        511 
May 19 12:19:22:836 [7824] cluster: sections[0]     PDS_PPDS        502 
May 19 12:19:22:836 [7824] cluster:  __section       PDS_PCH          38 /profiles/frhdgsp-apbct30\APBC~
May 19 12:19:22:836 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:836 [7824] cluster:  description     PDS_PCH           1 
May 19 12:19:22:836 [7824] cluster:  connection      PDS_PCH          28 frhdgsp-apbct30\APBCT100PPI
May 19 12:19:22:836 [7824] cluster:  interval        PDS_PCH           6 5 min
May 19 12:19:22:836 [7824] cluster:  heartbeat       PDS_PCH           6 5 sec
May 19 12:19:22:836 [7824] cluster:  p_timeout       PDS_PCH           7 15 min
May 19 12:19:22:836 [7824] cluster:  sql_timeout     PDS_PCH           7 30 sec
May 19 12:19:22:836 [7824] cluster:  p_tout_msg      PDS_PCH          12 p_timeout_1
May 19 12:19:22:836 [7824] cluster:  sql_tout_msg    PDS_PCH          14 sql_timeout_1
May 19 12:19:22:836 [7824] cluster:  tout_clear      PDS_PCH          16 timeout_clear_1
May 19 12:19:22:836 [7824] cluster:  p_tout_sev      PDS_PCH           6 major
May 19 12:19:22:836 [7824] cluster:  alarm_source    PDS_PCH           1 
May 19 12:19:22:837 [7824] cluster:  useFQDNQosSrc   PDS_PCH           3 no
May 19 12:19:22:837 [7824] cluster:  qos_source      PDS_PCH           1 
May 19 12:19:22:837 [7824] cluster:  sign_mode       PDS_PCH           2 0
May 19 12:19:22:837 [7824] cluster:  manual_run_script PDS_PCH           2 0
May 19 12:19:22:837 [7824] cluster:  group           PDS_PCH           6 MSSQL
May 19 12:19:22:837 [7824] cluster:  p_delay_sev     PDS_PCH           6 major
May 19 12:19:22:837 [7824] cluster:  delay_threshold PDS_PCH           7 15 sec
May 19 12:19:22:837 [7824] cluster:  suspended       PDS_PCH           3 no
May 19 12:19:22:837 [7824] cluster: ActivateResource Size=618
May 19 12:19:22:837 [7824] cluster: __file          PDS_PCH          73 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:837 [7824] cluster: sections        PDS_PPDS        511 
May 19 12:19:22:837 [7824] cluster: sections[0]     PDS_PPDS        502 
May 19 12:19:22:837 [7824] cluster:  __section       PDS_PCH          38 /profiles/frhdgsp-apbct30\APBC~
May 19 12:19:22:837 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:837 [7824] cluster:  description     PDS_PCH           1 
May 19 12:19:22:837 [7824] cluster:  connection      PDS_PCH          28 frhdgsp-apbct30\APBCT100PPI
May 19 12:19:22:837 [7824] cluster:  interval        PDS_PCH           6 5 min
May 19 12:19:22:837 [7824] cluster:  heartbeat       PDS_PCH           6 5 sec
May 19 12:19:22:837 [7824] cluster:  p_timeout       PDS_PCH           7 15 min
May 19 12:19:22:837 [7824] cluster:  sql_timeout     PDS_PCH           7 30 sec
May 19 12:19:22:837 [7824] cluster:  p_tout_msg      PDS_PCH          12 p_timeout_1
May 19 12:19:22:837 [7824] cluster:  sql_tout_msg    PDS_PCH          14 sql_timeout_1
May 19 12:19:22:837 [7824] cluster:  tout_clear      PDS_PCH          16 timeout_clear_1
May 19 12:19:22:837 [7824] cluster:  p_tout_sev      PDS_PCH           6 major
May 19 12:19:22:837 [7824] cluster:  alarm_source    PDS_PCH           1 
May 19 12:19:22:837 [7824] cluster:  useFQDNQosSrc   PDS_PCH           3 no
May 19 12:19:22:837 [7824] cluster:  qos_source      PDS_PCH           1 
May 19 12:19:22:837 [7824] cluster:  sign_mode       PDS_PCH           2 0
May 19 12:19:22:837 [7824] cluster:  manual_run_script PDS_PCH           2 0
May 19 12:19:22:837 [7824] cluster:  group           PDS_PCH           6 MSSQL
May 19 12:19:22:837 [7824] cluster:  p_delay_sev     PDS_PCH           6 major
May 19 12:19:22:837 [7824] cluster:  delay_threshold PDS_PCH           7 15 sec
May 19 12:19:22:837 [7824] cluster:  suspended       PDS_PCH           3 no
May 19 12:19:22:837 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:837 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:848 [7824] cluster: PdsToSection: section[/profiles/frhdgsp-apbct30\APBCT100PPI]
May 19 12:19:22:848 [7824] cluster: PdsToSection - section deleted=/profiles/frhdgsp-apbct30\APBCT100PPI size=502
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=active, val=yes
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=description, val=
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=connection, val=frhdgsp-apbct30\APBCT100PPI
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=interval, val=5 min
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=heartbeat, val=5 sec
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=p_timeout, val=15 min
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=sql_timeout, val=30 sec
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=p_tout_msg, val=p_timeout_1
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=sql_tout_msg, val=sql_timeout_1
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=tout_clear, val=timeout_clear_1
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=p_tout_sev, val=major
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=alarm_source, val=
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=useFQDNQosSrc, val=no
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=qos_source, val=
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=sign_mode, val=0
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=manual_run_script, val=0
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=group, val=MSSQL
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=p_delay_sev, val=major
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=delay_threshold, val=15 sec
May 19 12:19:22:848 [7824] cluster: PdsToSection - writing to cfg.. section=/profiles/frhdgsp-apbct30\APBCT100PPI key=suspended, val=no
May 19 12:19:22:861 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:861 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:861 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:861 [7824] cluster: ProbeInfoSetRestart - probe[sqlserver].. marking restart flag
May 19 12:19:22:861 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:861 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:861 [7824] cluster: SetResourceGroupOnline - Activate profile=/services/SQLAgent$APBCT100PPI
May 19 12:19:22:861 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:861 [7824] cluster: ActivateResource - probe=ntservices, profile=/services/SQLAgent$APBCT100PPI, file=FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:19:22:861 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/ntservices\ntservices.cfg
May 19 12:19:22:861 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds]- IN
May 19 12:19:22:870 [7824] cluster: PdsFromFile - read 652 bytes from FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:19:22:870 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:870 [7824] cluster: PdsFromFile Size=652
May 19 12:19:22:871 [7824] cluster: __file          PDS_PCH          65 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:871 [7824] cluster: sections        PDS_PPDS        553 
May 19 12:19:22:871 [7824] cluster: sections[0]     PDS_PPDS        544 
May 19 12:19:22:871 [7824] cluster:  __section       PDS_PCH          31 /services/SQLAgent$APBCT100PPI~
May 19 12:19:22:871 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:871 [7824] cluster:  display         PDS_PCH          31 SQL Server Agent (APBCT100PPI)~
May 19 12:19:22:871 [7824] cluster:  credentials     PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  state           PDS_PCH           8 running
May 19 12:19:22:871 [7824] cluster:  action          PDS_PCH           7 report
May 19 12:19:22:871 [7824] cluster:  qos_state       PDS_PCH           4 yes
May 19 12:19:22:871 [7824] cluster:  profile_name    PDS_PCH          31 SQL Server Agent (APBCT100PPI)~
May 19 12:19:22:871 [7824] cluster:  msg_max_restarts PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_restart_detected PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_restarting  PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_starting    PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_stopping    PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_wrong_state PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_wrong_credential PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_service_removed PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_service_profile_removed PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_service_send_clear PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  alarm_on_action PDS_PCH           4 yes
May 19 12:19:22:871 [7824] cluster:  alarm_on_remove PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  suppress        PDS_PCH           3 no
May 19 12:19:22:871 [7824] cluster:  suppression_key PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster: ActivateResource Size=652
May 19 12:19:22:871 [7824] cluster: __file          PDS_PCH          65 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:871 [7824] cluster: sections        PDS_PPDS        553 
May 19 12:19:22:871 [7824] cluster: sections[0]     PDS_PPDS        544 
May 19 12:19:22:871 [7824] cluster:  __section       PDS_PCH          31 /services/SQLAgent$APBCT100PPI~
May 19 12:19:22:871 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:871 [7824] cluster:  display         PDS_PCH          31 SQL Server Agent (APBCT100PPI)~
May 19 12:19:22:871 [7824] cluster:  credentials     PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  state           PDS_PCH           8 running
May 19 12:19:22:871 [7824] cluster:  action          PDS_PCH           7 report
May 19 12:19:22:871 [7824] cluster:  qos_state       PDS_PCH           4 yes
May 19 12:19:22:871 [7824] cluster:  profile_name    PDS_PCH          31 SQL Server Agent (APBCT100PPI)~
May 19 12:19:22:871 [7824] cluster:  msg_max_restarts PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_restart_detected PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_restarting  PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_starting    PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_stopping    PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_wrong_state PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_wrong_credential PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_service_removed PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_service_profile_removed PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  msg_service_send_clear PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  alarm_on_action PDS_PCH           4 yes
May 19 12:19:22:871 [7824] cluster:  alarm_on_remove PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster:  suppress        PDS_PCH           3 no
May 19 12:19:22:871 [7824] cluster:  suppression_key PDS_PCH           1 
May 19 12:19:22:871 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:871 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:872 [7824] cluster: PdsToSection: section[/services/SQLAgent$APBCT100PPI]
May 19 12:19:22:872 [7824] cluster: PdsToSection - section deleted=/services/SQLAgent$APBCT100PPI size=544
May 19 12:19:22:872 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=active, val=yes
May 19 12:19:22:872 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=display, val=SQL Server Agent (APBCT100PPI)
May 19 12:19:22:872 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=credentials, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=state, val=running
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=action, val=report
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=qos_state, val=yes
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=profile_name, val=SQL Server Agent (APBCT100PPI)
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_max_restarts, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_restart_detected, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_restarting, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_starting, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_stopping, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_wrong_state, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_wrong_credential, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_service_removed, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_service_profile_removed, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=msg_service_send_clear, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=alarm_on_action, val=yes
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=alarm_on_remove, val=
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=suppress, val=no
May 19 12:19:22:873 [7824] cluster: PdsToSection - writing to cfg.. section=/services/SQLAgent$APBCT100PPI key=suppression_key, val=
May 19 12:19:22:875 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:875 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:875 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:875 [7824] cluster: ProbeInfoSetRestart - probe[ntservices].. marking restart flag
May 19 12:19:22:875 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:875 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:875 [7824] cluster: SetResourceGroupOnline - Activate profile=/services/MSSQL$APBCT100PPI
May 19 12:19:22:875 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:875 [7824] cluster: ActivateResource - probe=ntservices, profile=/services/MSSQL$APBCT100PPI, file=FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:19:22:875 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/ntservices\ntservices.cfg
May 19 12:19:22:875 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\ntservices_qeqghqrc.pds]- IN
May 19 12:19:22:891 [7824] cluster: PdsFromFile - read 637 bytes from FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:19:22:891 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:891 [7824] cluster: PdsFromFile Size=637
May 19 12:19:22:891 [7824] cluster: __file          PDS_PCH          65 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:891 [7824] cluster: sections        PDS_PPDS        538 
May 19 12:19:22:891 [7824] cluster: sections[0]     PDS_PPDS        529 
May 19 12:19:22:891 [7824] cluster:  __section       PDS_PCH          28 /services/MSSQL$APBCT100PPI
May 19 12:19:22:891 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:891 [7824] cluster:  display         PDS_PCH          25 SQL Server (APBCT100PPI)
May 19 12:19:22:891 [7824] cluster:  credentials     PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  state           PDS_PCH           8 running
May 19 12:19:22:891 [7824] cluster:  action          PDS_PCH           7 report
May 19 12:19:22:891 [7824] cluster:  qos_state       PDS_PCH           4 yes
May 19 12:19:22:891 [7824] cluster:  profile_name    PDS_PCH          25 SQL Server (APBCT100PPI)
May 19 12:19:22:891 [7824] cluster:  msg_max_restarts PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_restart_detected PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_restarting  PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_starting    PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_stopping    PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_wrong_state PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_wrong_credential PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_service_removed PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_service_profile_removed PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_service_send_clear PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  alarm_on_action PDS_PCH           4 yes
May 19 12:19:22:891 [7824] cluster:  alarm_on_remove PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  suppress        PDS_PCH           3 no
May 19 12:19:22:891 [7824] cluster:  suppression_key PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster: ActivateResource Size=637
May 19 12:19:22:891 [7824] cluster: __file          PDS_PCH          65 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:891 [7824] cluster: sections        PDS_PPDS        538 
May 19 12:19:22:891 [7824] cluster: sections[0]     PDS_PPDS        529 
May 19 12:19:22:891 [7824] cluster:  __section       PDS_PCH          28 /services/MSSQL$APBCT100PPI
May 19 12:19:22:891 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:891 [7824] cluster:  display         PDS_PCH          25 SQL Server (APBCT100PPI)
May 19 12:19:22:891 [7824] cluster:  credentials     PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  state           PDS_PCH           8 running
May 19 12:19:22:891 [7824] cluster:  action          PDS_PCH           7 report
May 19 12:19:22:891 [7824] cluster:  qos_state       PDS_PCH           4 yes
May 19 12:19:22:891 [7824] cluster:  profile_name    PDS_PCH          25 SQL Server (APBCT100PPI)
May 19 12:19:22:891 [7824] cluster:  msg_max_restarts PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_restart_detected PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_restarting  PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_starting    PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_stopping    PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_wrong_state PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_wrong_credential PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_service_removed PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_service_profile_removed PDS_PCH           1 
May 19 12:19:22:891 [7824] cluster:  msg_service_send_clear PDS_PCH           1 
May 19 12:19:22:892 [7824] cluster:  alarm_on_action PDS_PCH           4 yes
May 19 12:19:22:892 [7824] cluster:  alarm_on_remove PDS_PCH           1 
May 19 12:19:22:892 [7824] cluster:  suppress        PDS_PCH           3 no
May 19 12:19:22:892 [7824] cluster:  suppression_key PDS_PCH           1 
May 19 12:19:22:892 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:892 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:893 [7824] cluster: PdsToSection: section[/services/MSSQL$APBCT100PPI]
May 19 12:19:22:893 [7824] cluster: PdsToSection - section deleted=/services/MSSQL$APBCT100PPI size=529
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=active, val=yes
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=display, val=SQL Server (APBCT100PPI)
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=credentials, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=state, val=running
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=action, val=report
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=qos_state, val=yes
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=profile_name, val=SQL Server (APBCT100PPI)
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_max_restarts, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_restart_detected, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_restarting, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_starting, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_stopping, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_wrong_state, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_wrong_credential, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_service_removed, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_service_profile_removed, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=msg_service_send_clear, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=alarm_on_action, val=yes
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=alarm_on_remove, val=
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=suppress, val=no
May 19 12:19:22:893 [7824] cluster: PdsToSection - writing to cfg.. section=/services/MSSQL$APBCT100PPI key=suppression_key, val=
May 19 12:19:22:896 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:896 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:896 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:896 [7824] cluster: ProbeInfoSetRestart - probe[ntservices].. marking restart flag
May 19 12:19:22:896 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:896 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:896 [7824] cluster: SetResourceGroupOnline - Activate profile=/disk/alarm/fixed/F:\
May 19 12:19:22:896 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:896 [7824] cluster: ActivateResource - probe=cdm, profile=/disk/alarm/fixed/F:\, file=FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:19:22:896 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:22:896 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_trvzcpvl.pds]- IN
May 19 12:19:22:898 [7824] cluster: PdsFromFile - read 1340 bytes from FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:19:22:898 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:898 [7824] cluster: PdsFromFile Size=1340
May 19 12:19:22:898 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:898 [7824] cluster: sections        PDS_PPDS       1255 
May 19 12:19:22:898 [7824] cluster: sections[0]     PDS_PPDS        476 
May 19 12:19:22:898 [7824] cluster:  __section       PDS_PCH          22 /disk/alarm/fixed/F:\
May 19 12:19:22:898 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:898 [7824] cluster:  description     PDS_PCH          16 File system F:\
May 19 12:19:22:899 [7824] cluster:  disk            PDS_PCH          25 \Device\HarddiskVolume62
May 19 12:19:22:899 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:899 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:899 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster: sections[1]     PDS_PPDS         98 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          28 /disk/alarm/fixed/F:\/error
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:899 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:899 [7824] cluster: sections[2]     PDS_PPDS        102 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/F:\/warning ~
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:899 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:899 [7824] cluster: sections[3]     PDS_PPDS        104 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/F:\/inode_er~
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:899 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:899 [7824] cluster: sections[4]     PDS_PPDS        108 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/F:\/inode_wa~
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:899 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:899 [7824] cluster: sections[5]     PDS_PPDS         85 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/F:\/missing ~
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:899 [7824] cluster: sections[6]     PDS_PPDS        105 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/F:\/delta_er~
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:899 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:899 [7824] cluster: sections[7]     PDS_PPDS        107 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/F:\/delta_wa~
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:899 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:899 [7824] cluster: ActivateResource Size=1340
May 19 12:19:22:899 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:899 [7824] cluster: sections        PDS_PPDS       1255 
May 19 12:19:22:899 [7824] cluster: sections[0]     PDS_PPDS        476 
May 19 12:19:22:899 [7824] cluster:  __section       PDS_PCH          22 /disk/alarm/fixed/F:\
May 19 12:19:22:899 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  description     PDS_PCH          16 File system F:\
May 19 12:19:22:899 [7824] cluster:  disk            PDS_PCH          25 \Device\HarddiskVolume62
May 19 12:19:22:899 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:899 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:899 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:899 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:900 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:900 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:900 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:900 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster: sections[1]     PDS_PPDS         98 
May 19 12:19:22:900 [7824] cluster:  __section       PDS_PCH          28 /disk/alarm/fixed/F:\/error
May 19 12:19:22:900 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:900 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:900 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:900 [7824] cluster: sections[2]     PDS_PPDS        102 
May 19 12:19:22:900 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/F:\/warning ~
May 19 12:19:22:900 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:900 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:900 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:900 [7824] cluster: sections[3]     PDS_PPDS        104 
May 19 12:19:22:900 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/F:\/inode_er~
May 19 12:19:22:900 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:900 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:900 [7824] cluster: sections[4]     PDS_PPDS        108 
May 19 12:19:22:900 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/F:\/inode_wa~
May 19 12:19:22:900 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:900 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:900 [7824] cluster: sections[5]     PDS_PPDS         85 
May 19 12:19:22:900 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/F:\/missing ~
May 19 12:19:22:900 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:900 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:900 [7824] cluster: sections[6]     PDS_PPDS        105 
May 19 12:19:22:900 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/F:\/delta_er~
May 19 12:19:22:900 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:900 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:900 [7824] cluster: sections[7]     PDS_PPDS        107 
May 19 12:19:22:900 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/F:\/delta_wa~
May 19 12:19:22:900 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:900 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:900 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:900 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:900 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:901 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\]
May 19 12:19:22:901 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\ size=476
May 19 12:19:22:901 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=active, val=no
May 19 12:19:22:901 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=description, val=File system F:\
May 19 12:19:22:901 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=disk, val=\Device\HarddiskVolume62
May 19 12:19:22:901 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=file_system_type, val=NTFS
May 19 12:19:22:901 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=percent, val=yes
May 19 12:19:22:901 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_disk_usage, val=no
May 19 12:19:22:901 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_disk_free, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_disk_free_perc, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_disk_total_size, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=inode_percent, val=yes
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_inode_usage, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_inode_usage_perc, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=delta_percent, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=delta_calculate_all, val=yes
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=delta_type, val=both
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_disk_delta, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\ key=qos_disk_delta_perc, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\/error]
May 19 12:19:22:902 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\/error size=98
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/error key=active, val=yes
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/error key=threshold, val=10
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/error key=message, val=DiskError
May 19 12:19:22:902 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\/warning]
May 19 12:19:22:902 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\/warning size=102
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/warning key=active, val=yes
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/warning key=threshold, val=15
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/warning key=message, val=DiskWarning
May 19 12:19:22:902 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\/inode_error]
May 19 12:19:22:902 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\/inode_error size=104
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/inode_error key=active, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/inode_error key=threshold, val=10
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/inode_error key=message, val=InodeError
May 19 12:19:22:902 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\/inode_warning]
May 19 12:19:22:902 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\/inode_warning size=108
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/inode_warning key=active, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/inode_warning key=threshold, val=20
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/inode_warning key=message, val=InodeWarning
May 19 12:19:22:902 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\/missing]
May 19 12:19:22:902 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\/missing size=85
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/missing key=active, val=yes
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/missing key=message, val=DiskMissing
May 19 12:19:22:902 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\/delta_error]
May 19 12:19:22:902 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\/delta_error size=105
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/delta_error key=active, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/delta_error key=threshold, val=200
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/delta_error key=message, val=DeltaError
May 19 12:19:22:902 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/F:\/delta_warning]
May 19 12:19:22:902 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/F:\/delta_warning size=107
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/delta_warning key=active, val=no
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/delta_warning key=threshold, val=8
May 19 12:19:22:902 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/F:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:22:905 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:905 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:905 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:905 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:22:905 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:905 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:905 [7824] cluster: SetResourceGroupOnline - Activate profile=/disk/alarm/fixed/E:\
May 19 12:19:22:905 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:905 [7824] cluster: ActivateResource - probe=cdm, profile=/disk/alarm/fixed/E:\, file=FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:19:22:905 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:22:905 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_skskokpi.pds]- IN
May 19 12:19:22:913 [7824] cluster: PdsFromFile - read 1340 bytes from FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:19:22:913 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:913 [7824] cluster: PdsFromFile Size=1340
May 19 12:19:22:913 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:913 [7824] cluster: sections        PDS_PPDS       1255 
May 19 12:19:22:913 [7824] cluster: sections[0]     PDS_PPDS        476 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          22 /disk/alarm/fixed/E:\
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  description     PDS_PCH          16 File system E:\
May 19 12:19:22:913 [7824] cluster:  disk            PDS_PCH          25 \Device\HarddiskVolume66
May 19 12:19:22:913 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:913 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:913 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:913 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:913 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:913 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:913 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster: sections[1]     PDS_PPDS         98 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          28 /disk/alarm/fixed/E:\/error
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:913 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:913 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:913 [7824] cluster: sections[2]     PDS_PPDS        102 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/E:\/warning ~
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:913 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:913 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:913 [7824] cluster: sections[3]     PDS_PPDS        104 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/E:\/inode_er~
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:913 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:913 [7824] cluster: sections[4]     PDS_PPDS        108 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/E:\/inode_wa~
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:913 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:913 [7824] cluster: sections[5]     PDS_PPDS         85 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/E:\/missing ~
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:913 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:913 [7824] cluster: sections[6]     PDS_PPDS        105 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/E:\/delta_er~
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:913 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:913 [7824] cluster: sections[7]     PDS_PPDS        107 
May 19 12:19:22:913 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/E:\/delta_wa~
May 19 12:19:22:913 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:913 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:913 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:913 [7824] cluster: ActivateResource Size=1340
May 19 12:19:22:914 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:914 [7824] cluster: sections        PDS_PPDS       1255 
May 19 12:19:22:914 [7824] cluster: sections[0]     PDS_PPDS        476 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          22 /disk/alarm/fixed/E:\
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  description     PDS_PCH          16 File system E:\
May 19 12:19:22:914 [7824] cluster:  disk            PDS_PCH          25 \Device\HarddiskVolume66
May 19 12:19:22:914 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:914 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:914 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:914 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:914 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:914 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:914 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster: sections[1]     PDS_PPDS         98 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          28 /disk/alarm/fixed/E:\/error
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:914 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:914 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:914 [7824] cluster: sections[2]     PDS_PPDS        102 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/E:\/warning ~
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:914 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:914 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:914 [7824] cluster: sections[3]     PDS_PPDS        104 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/E:\/inode_er~
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:914 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:914 [7824] cluster: sections[4]     PDS_PPDS        108 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/E:\/inode_wa~
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:914 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:914 [7824] cluster: sections[5]     PDS_PPDS         85 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          30 /disk/alarm/fixed/E:\/missing ~
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:914 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:914 [7824] cluster: sections[6]     PDS_PPDS        105 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          34 /disk/alarm/fixed/E:\/delta_er~
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:914 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:914 [7824] cluster: sections[7]     PDS_PPDS        107 
May 19 12:19:22:914 [7824] cluster:  __section       PDS_PCH          36 /disk/alarm/fixed/E:\/delta_wa~
May 19 12:19:22:914 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:914 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:914 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:914 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:914 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:915 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\ size=476
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=active, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=description, val=File system E:\
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=disk, val=\Device\HarddiskVolume66
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=file_system_type, val=NTFS
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=percent, val=yes
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_disk_usage, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_disk_free, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_disk_free_perc, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_disk_total_size, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=inode_percent, val=yes
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_inode_usage, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_inode_usage_perc, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=delta_percent, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=delta_calculate_all, val=yes
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=delta_type, val=both
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_disk_delta, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\ key=qos_disk_delta_perc, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\/error]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\/error size=98
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/error key=active, val=yes
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/error key=threshold, val=10
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/error key=message, val=DiskError
May 19 12:19:22:916 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\/warning]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\/warning size=102
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/warning key=active, val=yes
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/warning key=threshold, val=15
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/warning key=message, val=DiskWarning
May 19 12:19:22:916 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\/inode_error]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\/inode_error size=104
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/inode_error key=active, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/inode_error key=threshold, val=10
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/inode_error key=message, val=InodeError
May 19 12:19:22:916 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\/inode_warning]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\/inode_warning size=108
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/inode_warning key=active, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/inode_warning key=threshold, val=20
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/inode_warning key=message, val=InodeWarning
May 19 12:19:22:916 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\/missing]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\/missing size=85
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/missing key=active, val=yes
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/missing key=message, val=DiskMissing
May 19 12:19:22:916 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\/delta_error]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\/delta_error size=105
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/delta_error key=active, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/delta_error key=threshold, val=200
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/delta_error key=message, val=DeltaError
May 19 12:19:22:916 [7824] cluster: PdsToSection: section[/disk/alarm/fixed/E:\/delta_warning]
May 19 12:19:22:916 [7824] cluster: PdsToSection - section deleted=/disk/alarm/fixed/E:\/delta_warning size=107
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/delta_warning key=active, val=no
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/delta_warning key=threshold, val=8
May 19 12:19:22:916 [7824] cluster: PdsToSection - writing to cfg.. section=/disk/alarm/fixed/E:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:22:919 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:919 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:919 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:919 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:22:919 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:919 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:919 [7824] cluster: SetResourceGroupOnline(): - OUT
May 19 12:19:22:919 [7824] cluster: MapResourceGroups - group=FRHDGSP-APBCT03 is Online
May 19 12:19:22:919 [7824] cluster: MapResourceGroups - pchMsg set Free
May 19 12:19:22:919 [7824] cluster: MapResourceGroups - CiName set to FRHDCLI-APBCT01-FRHDGSP-APBCT03
May 19 12:19:22:919 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:919 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:919 [7824] cluster: MapResourceGroups - Successfuly open ciOpenLocalDevice
May 19 12:19:22:919 [7824] cluster: MapResourceGroups - Sending QoS - Group=FRHDGSP-APBCT03, state=1 (Online)
May 19 12:19:22:919 [7824] cluster: MapResourceGroups - set QoS Sample time
May 19 12:19:22:919 [7824] cluster: MapResourceGroups - QoS Binding Done
May 19 12:19:22:920 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:920 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:920 [7824] cluster:  data   nimid=NR94975670-08725
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - QoS Sent
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - QoS un Binding Done
May 19 12:19:22:920 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56068
May 19 12:19:22:920 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:920 [7824] cluster: ciClose - [C07340468AFBEF0B55F4CDA8F9F39181F]
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - local Qos and ci Closed
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - pds Deleted
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:22:920 [7824] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:22:920 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:22:920 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:22:920 [7824] cluster: FindNode() End - OUT
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:22:920 [7824] cluster: FindGroup(): - IN
May 19 12:19:22:920 [7824] cluster: FindGroup(): - OUT
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - resource group 'FRHDGSP-APBCT40' is running on cluster node 'FRHDCLI-APBCT01'
May 19 12:19:22:920 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:22:920 [7824] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:22:920 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT40 is inactive
May 19 12:19:22:920 [7824] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:19:22:920 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT40 is inactive
May 19 12:19:22:920 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - (Alarm Check)Ci Name is 
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - state = 0 : Send Clear Alarm
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - Msg = Resource group 'FRHDGSP-APBCT40' is Online.Resources: 'BackUpFileShare' :Online   'Cluster Disk 3' :Online   'File Server (\\FRHDGSP-APBCT40)' :Online   'FRHDGSP-APBCT40' :Online   'IP Address 10.27.163.137' :Online   
May 19 12:19:22:920 [7824] cluster: MapResourceGroups - Token = (null)
May 19 12:19:22:920 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:920 [7824] cluster: ciSave - saving CI   [C8592B86CA0A4F9400261A0E03CEE588A]
May 19 12:19:22:921 [7824] cluster: SendAlarm - sev=0 msg=Resource group 'FRHDGSP-APBCT40' is Online.Resources: 'BackUpFileShare' :Online   'Cluster Disk 3' :Online   'File Server (\\FRHDGSP-APBCT40)' :Online   'FRHDGSP-APBCT40' :Online   'IP Address 10.27.163.137' :Online    sup=cluster/FRHDGSP-APBCT40 src=
May 19 12:19:22:921 [7824] cluster: ciSaveMetric - saving MET [M276B58DC113C8082D3C7E9C9D9EC52C6] 1.18:1
May 19 12:19:22:921 [7824] cluster: ciPostMessage - alarm
May 19 12:19:22:922 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:922 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:922 [7824] cluster:  data   nimid=NR94975670-08726
May 19 12:19:22:922 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56069
May 19 12:19:22:922 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:922 [7824] cluster: ciClose - [C8592B86CA0A4F9400261A0E03CEE588A]
May 19 12:19:22:922 [7824] cluster: SetResourceGroupOnline(): - IN
May 19 12:19:22:922 [7824] cluster: SetResourceGroupOnline - FRHDGSP-APBCT40
May 19 12:19:22:922 [7824] cluster: SetResourceGroupOnline - Activate profile=/messages
May 19 12:19:22:922 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:922 [7824] cluster: ActivateResource - probe=cdm, profile=/messages, file=FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:19:22:922 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:22:922 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_hlrdhxrp.pds]- IN
May 19 12:19:22:934 [7824] cluster: PdsFromFile - read 17669 bytes from FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:19:22:934 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:934 [7824] cluster: PdsFromFile Size=17669
May 19 12:19:22:934 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:934 [7824] cluster: sections        PDS_PPDS      17584 
May 19 12:19:22:934 [7824] cluster: sections[0]     PDS_PPDS         25 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          10 /messages
May 19 12:19:22:934 [7824] cluster: sections[1]     PDS_PPDS        264 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          19 /messages/CpuError
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         117 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          10 cpu_error
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:934 [7824] cluster: sections[2]     PDS_PPDS        271 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          21 /messages/CpuWarning
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         119 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          12 cpu_warning
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:934 [7824] cluster: sections[3]     PDS_PPDS        331 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuErrorProcesses
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         142 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          20 cpu_error_processes
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:934 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:934 [7824] cluster: sections[4]     PDS_PPDS        335 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          30 /messages/CpuWarningProcesses ~
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         144 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          22 cpu_warning_processes
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:934 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:934 [7824] cluster: sections[5]     PDS_PPDS        263 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuError-Ind
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         109 Individual CPU Usage for cpu($~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          14 cpu_error_ind
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:934 [7824] cluster: sections[6]     PDS_PPDS        270 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuWarning-Ind
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         111 Individual CPU Usage for cpu($~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          16 cpu_warning_ind
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:934 [7824] cluster: sections[7]     PDS_PPDS        270 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuUserError
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          15 cpu_user_error
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:934 [7824] cluster: sections[8]     PDS_PPDS        277 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuUserWarning
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          17 cpu_user_warning
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:934 [7824] cluster: sections[9]     PDS_PPDS        269 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuUserError-Ind
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         108 Individual CPU User for cpu($i~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          19 cpu_user_error_ind
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:934 [7824] cluster: sections[10]    PDS_PPDS        276 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuUserWarning-Ind
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         110 Individual CPU User for cpu($i~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          21 cpu_user_warning_ind
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:934 [7824] cluster: sections[11]    PDS_PPDS        276 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuSystemError
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          17 cpu_system_error
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:934 [7824] cluster: sections[12]    PDS_PPDS        283 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuSystemWarning
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          19 cpu_system_warning
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:934 [7824] cluster: sections[13]    PDS_PPDS        275 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuSystemError-Ind
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         110 Individual CPU System for cpu(~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:934 [7824] cluster:  token           PDS_PCH          21 cpu_system_error_ind
May 19 12:19:22:934 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:934 [7824] cluster: sections[14]    PDS_PPDS        289 
May 19 12:19:22:934 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuSystemWarning-Ind~
May 19 12:19:22:934 [7824] cluster:  text            PDS_PCH         119 Individual CPU System for cpu(~
May 19 12:19:22:934 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          23 cpu_system_warning_ind
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:935 [7824] cluster: sections[15]    PDS_PPDS        278 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIOWaitError
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          17 cpu_iowait_error
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:935 [7824] cluster: sections[16]    PDS_PPDS        285 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIOWaitWarning
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          19 cpu_iowait_warning
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:935 [7824] cluster: sections[17]    PDS_PPDS        277 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIOWaitError-Ind
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         110 Individual CPU IOWait for cpu(~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          21 cpu_iowait_error_ind
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:935 [7824] cluster: sections[18]    PDS_PPDS        284 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuIOWaitWarning-Ind~
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         112 Individual CPU IOWait for cpu(~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          23 cpu_iowait_warning_ind
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:935 [7824] cluster: sections[19]    PDS_PPDS        270 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuIdleError
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          15 cpu_idle_error
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:935 [7824] cluster: sections[20]    PDS_PPDS        277 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIdleWarning
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          17 cpu_idle_warning
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:935 [7824] cluster: sections[21]    PDS_PPDS        269 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIdleError-Ind
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         108 Individual CPU Idle for cpu($i~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          19 cpu_idle_error_ind
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:935 [7824] cluster: sections[22]    PDS_PPDS        276 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIdleWarning-Ind
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         110 Individual CPU Idle for cpu($i~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          21 cpu_idle_warning_ind
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:935 [7824] cluster: sections[23]    PDS_PPDS        223 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuMultiMaxError
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH          81 Average of single cpu (id=$max~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          20 cpu_multi_max_error
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          27 as#system.cdm.arg_sngl_cpu
May 19 12:19:22:935 [7824] cluster: sections[24]    PDS_PPDS        308 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuMultiDiffError
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         147 $check_name: Difference betwee~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          21 cpu_multi_diff_error
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.diff_highest_low~
May 19 12:19:22:935 [7824] cluster: sections[25]    PDS_PPDS        295 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          24 /messages/PagefileError
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          15 pagefile_error
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:935 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:935 [7824] cluster: sections[26]    PDS_PPDS        299 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          26 /messages/PagefileWarning
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         122 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          17 pagefile_warning
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:935 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:935 [7824] cluster: sections[27]    PDS_PPDS        264 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          22 /messages/PagingError
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         114 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          13 paging_error
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:935 [7824] cluster: sections[28]    PDS_PPDS        271 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          24 /messages/PagingWarning
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          15 paging_warning
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:935 [7824] cluster: sections[29]    PDS_PPDS        290 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          26 /messages/PhysicalWarning
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          17 physical_warning
May 19 12:19:22:935 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:935 [7824] cluster: sections[30]    PDS_PPDS        342 
May 19 12:19:22:935 [7824] cluster:  __section       PDS_PCH          35 /messages/PhysicalWarningProce~
May 19 12:19:22:935 [7824] cluster:  text            PDS_PCH         157 Average ($value_number samples~
May 19 12:19:22:935 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:935 [7824] cluster:  token           PDS_PCH          27 physical_warning_processes
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:936 [7824] cluster: sections[31]    PDS_PPDS        272 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          20 /messages/SwapError
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH         125 Average ($value_number samples~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          11 swap_error
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:936 [7824] cluster: sections[32]    PDS_PPDS        279 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          22 /messages/SwapWarning
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH         127 Average ($value_number samples~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          13 swap_warning
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:936 [7824] cluster: sections[33]    PDS_PPDS        322 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          20 /messages/DiskError
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH         150 Average ($value_number samples~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          11 disk_error
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:936 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:936 [7824] cluster: sections[34]    PDS_PPDS        326 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskWarning
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH         152 Average ($value_number samples~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          13 disk_warning
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:936 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:936 [7824] cluster: sections[35]    PDS_PPDS        282 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          21 /messages/InodeError
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          12 inode_error
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:936 [7824] cluster: sections[36]    PDS_PPDS        289 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          23 /messages/InodeWarning
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          14 inode_warning
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:936 [7824] cluster: sections[37]    PDS_PPDS        210 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          21 /messages/DeltaError
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:936 [7824] cluster: sections[38]    PDS_PPDS        214 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          23 /messages/DeltaWarning
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:936 [7824] cluster: sections[39]    PDS_PPDS        191 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMissing
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          49 $disk_type file system $filesy~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          13 disk_missing
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          36 as#system.cdm.local_filesys_no~
May 19 12:19:22:936 [7824] cluster: sections[40]    PDS_PPDS        185 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMounted
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          43 Network disk $drive ($disk) is~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          13 disk_mounted
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          39 as#system.cdm.network_disk_not~
May 19 12:19:22:936 [7824] cluster: sections[41]    PDS_PPDS        186 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          26 /messages/ConnectionError
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          44 Network connection error; $dri~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          17 connection_error
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          31 as#system.cdm.network_conn_err~
May 19 12:19:22:936 [7824] cluster: sections[42]    PDS_PPDS        275 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          23 /messages/ProcQueueLen
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH         134 Average ($value_number samples~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          11 proc_q_len
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          38 as#system.cdm.avrg_processor_q~
May 19 12:19:22:936 [7824] cluster: sections[43]    PDS_PPDS        201 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          20 /messages/BootAlarm
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          54 $check_name: Computer has been~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:936 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          11 boot_alarm
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          26 as#system.cdm.comp_reboot
May 19 12:19:22:936 [7824] cluster: sections[44]    PDS_PPDS        188 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          24 /messages/InternalAlarm
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          33 $check_name: $situation ($erro~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:936 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          15 internal_alarm
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          28 as#system.cdm.situation_err
May 19 12:19:22:936 [7824] cluster: sections[45]    PDS_PPDS        256 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          24 /messages/DiskRateError
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:936 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:936 [7824] cluster:  token           PDS_PCH          16 disk_rate_error
May 19 12:19:22:936 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:936 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.disk_rate_above_~
May 19 12:19:22:936 [7824] cluster: sections[46]    PDS_PPDS        265 
May 19 12:19:22:936 [7824] cluster:  __section       PDS_PCH          26 /messages/DiskRateWarning
May 19 12:19:22:936 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          18 disk_rate_warning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          45 as#system.cdm.disk_rate_above_~
May 19 12:19:22:937 [7824] cluster: sections[47]    PDS_PPDS        274 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          31 /messages/DiskReadLatencyError~
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          24 disk_read_latency_error
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:937 [7824] cluster: sections[48]    PDS_PPDS        283 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          33 /messages/DiskReadLatencyWarni~
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          26 disk_read_latency_warning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:937 [7824] cluster: sections[49]    PDS_PPDS        285 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          34 /messages/DiskWriteLatencyWarn~
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          27 disk_write_latency_warning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:937 [7824] cluster: sections[50]    PDS_PPDS        276 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          32 /messages/DiskWriteLatencyErro~
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          25 disk_write_latency_error
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:937 [7824] cluster: sections[51]    PDS_PPDS        274 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          29 /messages/DiskLatencyWarning
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          21 disk_latency_warning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:937 [7824] cluster: sections[52]    PDS_PPDS        265 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          27 /messages/DiskLatencyError
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          19 disk_latency_error
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:937 [7824] cluster: sections[53]    PDS_PPDS        251 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          23 /messages/NICRateError
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          15 nic_rate_error
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.nic_rate_above_e~
May 19 12:19:22:937 [7824] cluster: sections[54]    PDS_PPDS        260 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          25 /messages/NICRateWarning
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          17 nic_rate_warning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.nic_rate_above_w~
May 19 12:19:22:937 [7824] cluster: sections[55]    PDS_PPDS        278 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          25 /messages/SystemMemError
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          17 system_mem_major
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.system_memory_ab~
May 19 12:19:22:937 [7824] cluster: sections[56]    PDS_PPDS        286 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          27 /messages/SystemMemWarning
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          19 system_mem_warning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.system_memory_ab~
May 19 12:19:22:937 [7824] cluster: sections[57]    PDS_PPDS        268 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          23 /messages/UserMemError
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          92 User memory utilization is now~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          15 user_mem_major
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.user_memory_abov~
May 19 12:19:22:937 [7824] cluster: sections[58]    PDS_PPDS        278 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          25 /messages/UserMemWarning
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH          94 User memory utilization is now~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          17 user_mem_warning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.user_memory_abov~
May 19 12:19:22:937 [7824] cluster: sections[59]    PDS_PPDS        326 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          27 /messages/AvailableWarning
May 19 12:19:22:937 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:937 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.available_memory~
May 19 12:19:22:937 [7824] cluster:  text            PDS_PCH         126 Average ($value_number samples~
May 19 12:19:22:937 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:937 [7824] cluster:  token           PDS_PCH          25 available_memory_warning
May 19 12:19:22:937 [7824] cluster: sections[60]    PDS_PPDS        316 
May 19 12:19:22:937 [7824] cluster:  __section       PDS_PCH          25 /messages/AvailableError
May 19 12:19:22:938 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          53 as#system.cdm.available_memory~
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         124 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          23 available_memory_error
May 19 12:19:22:938 [7824] cluster: sections[61]    PDS_PPDS        286 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          24 /messages/PhysicalError
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          15 physical_error
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:938 [7824] cluster: sections[62]    PDS_PPDS        336 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          33 /messages/PhysicalErrorProcess~
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         155 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          25 physical_error_processes
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:938 [7824] cluster: ActivateResource Size=17669
May 19 12:19:22:938 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:938 [7824] cluster: sections        PDS_PPDS      17584 
May 19 12:19:22:938 [7824] cluster: sections[0]     PDS_PPDS         25 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          10 /messages
May 19 12:19:22:938 [7824] cluster: sections[1]     PDS_PPDS        264 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          19 /messages/CpuError
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         117 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          10 cpu_error
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:938 [7824] cluster: sections[2]     PDS_PPDS        271 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          21 /messages/CpuWarning
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         119 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          12 cpu_warning
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:938 [7824] cluster: sections[3]     PDS_PPDS        331 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuErrorProcesses
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         142 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          20 cpu_error_processes
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:938 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:938 [7824] cluster: sections[4]     PDS_PPDS        335 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          30 /messages/CpuWarningProcesses ~
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         144 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          22 cpu_warning_processes
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:938 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:938 [7824] cluster: sections[5]     PDS_PPDS        263 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuError-Ind
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         109 Individual CPU Usage for cpu($~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          14 cpu_error_ind
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:938 [7824] cluster: sections[6]     PDS_PPDS        270 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuWarning-Ind
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         111 Individual CPU Usage for cpu($~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          16 cpu_warning_ind
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:938 [7824] cluster: sections[7]     PDS_PPDS        270 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuUserError
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          15 cpu_user_error
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:938 [7824] cluster: sections[8]     PDS_PPDS        277 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuUserWarning
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          17 cpu_user_warning
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:938 [7824] cluster: sections[9]     PDS_PPDS        269 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuUserError-Ind
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         108 Individual CPU User for cpu($i~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          19 cpu_user_error_ind
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:938 [7824] cluster: sections[10]    PDS_PPDS        276 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuUserWarning-Ind
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         110 Individual CPU User for cpu($i~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          21 cpu_user_warning_ind
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:938 [7824] cluster: sections[11]    PDS_PPDS        276 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuSystemError
May 19 12:19:22:938 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:938 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:938 [7824] cluster:  token           PDS_PCH          17 cpu_system_error
May 19 12:19:22:938 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:938 [7824] cluster: sections[12]    PDS_PPDS        283 
May 19 12:19:22:938 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuSystemWarning
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          19 cpu_system_warning
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:939 [7824] cluster: sections[13]    PDS_PPDS        275 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuSystemError-Ind
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         110 Individual CPU System for cpu(~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          21 cpu_system_error_ind
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:939 [7824] cluster: sections[14]    PDS_PPDS        289 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuSystemWarning-Ind~
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         119 Individual CPU System for cpu(~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          23 cpu_system_warning_ind
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:939 [7824] cluster: sections[15]    PDS_PPDS        278 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIOWaitError
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          17 cpu_iowait_error
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:939 [7824] cluster: sections[16]    PDS_PPDS        285 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIOWaitWarning
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          19 cpu_iowait_warning
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:939 [7824] cluster: sections[17]    PDS_PPDS        277 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIOWaitError-Ind
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         110 Individual CPU IOWait for cpu(~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          21 cpu_iowait_error_ind
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:939 [7824] cluster: sections[18]    PDS_PPDS        284 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuIOWaitWarning-Ind~
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         112 Individual CPU IOWait for cpu(~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          23 cpu_iowait_warning_ind
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:939 [7824] cluster: sections[19]    PDS_PPDS        270 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuIdleError
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          15 cpu_idle_error
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:939 [7824] cluster: sections[20]    PDS_PPDS        277 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIdleWarning
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          17 cpu_idle_warning
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:939 [7824] cluster: sections[21]    PDS_PPDS        269 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIdleError-Ind
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         108 Individual CPU Idle for cpu($i~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          19 cpu_idle_error_ind
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:939 [7824] cluster: sections[22]    PDS_PPDS        276 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIdleWarning-Ind
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         110 Individual CPU Idle for cpu($i~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          21 cpu_idle_warning_ind
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:939 [7824] cluster: sections[23]    PDS_PPDS        223 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuMultiMaxError
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH          81 Average of single cpu (id=$max~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          20 cpu_multi_max_error
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          27 as#system.cdm.arg_sngl_cpu
May 19 12:19:22:939 [7824] cluster: sections[24]    PDS_PPDS        308 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuMultiDiffError
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         147 $check_name: Difference betwee~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          21 cpu_multi_diff_error
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.diff_highest_low~
May 19 12:19:22:939 [7824] cluster: sections[25]    PDS_PPDS        295 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          24 /messages/PagefileError
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          15 pagefile_error
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:939 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:939 [7824] cluster: sections[26]    PDS_PPDS        299 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          26 /messages/PagefileWarning
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         122 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          17 pagefile_warning
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:939 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:939 [7824] cluster: sections[27]    PDS_PPDS        264 
May 19 12:19:22:939 [7824] cluster:  __section       PDS_PCH          22 /messages/PagingError
May 19 12:19:22:939 [7824] cluster:  text            PDS_PCH         114 Average ($value_number samples~
May 19 12:19:22:939 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:939 [7824] cluster:  token           PDS_PCH          13 paging_error
May 19 12:19:22:939 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:939 [7824] cluster: sections[28]    PDS_PPDS        271 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          24 /messages/PagingWarning
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          15 paging_warning
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:940 [7824] cluster: sections[29]    PDS_PPDS        290 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          26 /messages/PhysicalWarning
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          17 physical_warning
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:940 [7824] cluster: sections[30]    PDS_PPDS        342 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          35 /messages/PhysicalWarningProce~
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         157 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          27 physical_warning_processes
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:940 [7824] cluster: sections[31]    PDS_PPDS        272 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          20 /messages/SwapError
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         125 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          11 swap_error
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:940 [7824] cluster: sections[32]    PDS_PPDS        279 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          22 /messages/SwapWarning
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         127 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          13 swap_warning
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:940 [7824] cluster: sections[33]    PDS_PPDS        322 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          20 /messages/DiskError
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         150 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          11 disk_error
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:940 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:940 [7824] cluster: sections[34]    PDS_PPDS        326 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskWarning
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         152 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          13 disk_warning
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:940 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:940 [7824] cluster: sections[35]    PDS_PPDS        282 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          21 /messages/InodeError
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          12 inode_error
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:940 [7824] cluster: sections[36]    PDS_PPDS        289 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          23 /messages/InodeWarning
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          14 inode_warning
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:940 [7824] cluster: sections[37]    PDS_PPDS        210 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          21 /messages/DeltaError
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:940 [7824] cluster: sections[38]    PDS_PPDS        214 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          23 /messages/DeltaWarning
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:940 [7824] cluster: sections[39]    PDS_PPDS        191 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMissing
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH          49 $disk_type file system $filesy~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          13 disk_missing
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          36 as#system.cdm.local_filesys_no~
May 19 12:19:22:940 [7824] cluster: sections[40]    PDS_PPDS        185 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMounted
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH          43 Network disk $drive ($disk) is~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          13 disk_mounted
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          39 as#system.cdm.network_disk_not~
May 19 12:19:22:940 [7824] cluster: sections[41]    PDS_PPDS        186 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          26 /messages/ConnectionError
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH          44 Network connection error; $dri~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          17 connection_error
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          31 as#system.cdm.network_conn_err~
May 19 12:19:22:940 [7824] cluster: sections[42]    PDS_PPDS        275 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          23 /messages/ProcQueueLen
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH         134 Average ($value_number samples~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:940 [7824] cluster:  token           PDS_PCH          11 proc_q_len
May 19 12:19:22:940 [7824] cluster:  i18n_token      PDS_PCH          38 as#system.cdm.avrg_processor_q~
May 19 12:19:22:940 [7824] cluster: sections[43]    PDS_PPDS        201 
May 19 12:19:22:940 [7824] cluster:  __section       PDS_PCH          20 /messages/BootAlarm
May 19 12:19:22:940 [7824] cluster:  text            PDS_PCH          54 $check_name: Computer has been~
May 19 12:19:22:940 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:940 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          11 boot_alarm
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          26 as#system.cdm.comp_reboot
May 19 12:19:22:941 [7824] cluster: sections[44]    PDS_PPDS        188 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          24 /messages/InternalAlarm
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          33 $check_name: $situation ($erro~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          15 internal_alarm
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          28 as#system.cdm.situation_err
May 19 12:19:22:941 [7824] cluster: sections[45]    PDS_PPDS        256 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          24 /messages/DiskRateError
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          16 disk_rate_error
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.disk_rate_above_~
May 19 12:19:22:941 [7824] cluster: sections[46]    PDS_PPDS        265 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          26 /messages/DiskRateWarning
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          18 disk_rate_warning
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          45 as#system.cdm.disk_rate_above_~
May 19 12:19:22:941 [7824] cluster: sections[47]    PDS_PPDS        274 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          31 /messages/DiskReadLatencyError~
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          24 disk_read_latency_error
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:941 [7824] cluster: sections[48]    PDS_PPDS        283 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          33 /messages/DiskReadLatencyWarni~
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          26 disk_read_latency_warning
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:941 [7824] cluster: sections[49]    PDS_PPDS        285 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          34 /messages/DiskWriteLatencyWarn~
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          27 disk_write_latency_warning
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:941 [7824] cluster: sections[50]    PDS_PPDS        276 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          32 /messages/DiskWriteLatencyErro~
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          25 disk_write_latency_error
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:941 [7824] cluster: sections[51]    PDS_PPDS        274 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          29 /messages/DiskLatencyWarning
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          21 disk_latency_warning
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:941 [7824] cluster: sections[52]    PDS_PPDS        265 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          27 /messages/DiskLatencyError
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          19 disk_latency_error
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:941 [7824] cluster: sections[53]    PDS_PPDS        251 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          23 /messages/NICRateError
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          15 nic_rate_error
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.nic_rate_above_e~
May 19 12:19:22:941 [7824] cluster: sections[54]    PDS_PPDS        260 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          25 /messages/NICRateWarning
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          17 nic_rate_warning
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.nic_rate_above_w~
May 19 12:19:22:941 [7824] cluster: sections[55]    PDS_PPDS        278 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          25 /messages/SystemMemError
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          17 system_mem_major
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.system_memory_ab~
May 19 12:19:22:941 [7824] cluster: sections[56]    PDS_PPDS        286 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          27 /messages/SystemMemWarning
May 19 12:19:22:941 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:941 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:941 [7824] cluster:  token           PDS_PCH          19 system_mem_warning
May 19 12:19:22:941 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:941 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.system_memory_ab~
May 19 12:19:22:941 [7824] cluster: sections[57]    PDS_PPDS        268 
May 19 12:19:22:941 [7824] cluster:  __section       PDS_PCH          23 /messages/UserMemError
May 19 12:19:22:942 [7824] cluster:  text            PDS_PCH          92 User memory utilization is now~
May 19 12:19:22:942 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:942 [7824] cluster:  token           PDS_PCH          15 user_mem_major
May 19 12:19:22:942 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:942 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.user_memory_abov~
May 19 12:19:22:942 [7824] cluster: sections[58]    PDS_PPDS        278 
May 19 12:19:22:942 [7824] cluster:  __section       PDS_PCH          25 /messages/UserMemWarning
May 19 12:19:22:942 [7824] cluster:  text            PDS_PCH          94 User memory utilization is now~
May 19 12:19:22:942 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:942 [7824] cluster:  token           PDS_PCH          17 user_mem_warning
May 19 12:19:22:942 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:942 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.user_memory_abov~
May 19 12:19:22:942 [7824] cluster: sections[59]    PDS_PPDS        326 
May 19 12:19:22:942 [7824] cluster:  __section       PDS_PCH          27 /messages/AvailableWarning
May 19 12:19:22:942 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:942 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.available_memory~
May 19 12:19:22:942 [7824] cluster:  text            PDS_PCH         126 Average ($value_number samples~
May 19 12:19:22:942 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:942 [7824] cluster:  token           PDS_PCH          25 available_memory_warning
May 19 12:19:22:942 [7824] cluster: sections[60]    PDS_PPDS        316 
May 19 12:19:22:942 [7824] cluster:  __section       PDS_PCH          25 /messages/AvailableError
May 19 12:19:22:942 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:942 [7824] cluster:  i18n_token      PDS_PCH          53 as#system.cdm.available_memory~
May 19 12:19:22:942 [7824] cluster:  text            PDS_PCH         124 Average ($value_number samples~
May 19 12:19:22:942 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:942 [7824] cluster:  token           PDS_PCH          23 available_memory_error
May 19 12:19:22:942 [7824] cluster: sections[61]    PDS_PPDS        286 
May 19 12:19:22:942 [7824] cluster:  __section       PDS_PCH          24 /messages/PhysicalError
May 19 12:19:22:942 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:942 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:942 [7824] cluster:  token           PDS_PCH          15 physical_error
May 19 12:19:22:942 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:942 [7824] cluster: sections[62]    PDS_PPDS        336 
May 19 12:19:22:942 [7824] cluster:  __section       PDS_PCH          33 /messages/PhysicalErrorProcess~
May 19 12:19:22:942 [7824] cluster:  text            PDS_PCH         155 Average ($value_number samples~
May 19 12:19:22:942 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:942 [7824] cluster:  token           PDS_PCH          25 physical_error_processes
May 19 12:19:22:942 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:942 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:942 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:943 [7824] cluster: PdsToSection: section[/messages]
May 19 12:19:22:943 [7824] cluster: PdsToSection - section deleted=/messages size=25
May 19 12:19:22:943 [7824] cluster: PdsToSection: section[/messages/CpuError]
May 19 12:19:22:943 [7824] cluster: PdsToSection - section deleted=/messages/CpuError size=264
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=level, val=major
May 19 12:19:22:943 [7824] cluster: PdsToSection - section deleted=/messages/CpuError size=264
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=level, val=major
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=token, val=cpu_error
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_err_threshold
May 19 12:19:22:943 [7824] cluster: PdsToSection: section[/messages/CpuWarning]
May 19 12:19:22:943 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarning size=271
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=level, val=minor
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=token, val=cpu_warning
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_warn_threshold
May 19 12:19:22:943 [7824] cluster: PdsToSection: section[/messages/CpuErrorProcesses]
May 19 12:19:22:943 [7824] cluster: PdsToSection - section deleted=/messages/CpuErrorProcesses size=331
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the error threshold ($value_limit$unit).Top Processes $processes
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=level, val=critical
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=token, val=cpu_error_processes
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_err_threshold_proc
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=subsystem, val=
May 19 12:19:22:943 [7824] cluster: PdsToSection: section[/messages/CpuWarningProcesses]
May 19 12:19:22:943 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarningProcesses size=335
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the warning threshold ($value_limit$unit).Top Processes $processes
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=level, val=major
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=token, val=cpu_warning_processes
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_warn_threshold_proc
May 19 12:19:22:943 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=subsystem, val=
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuError-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuError-Ind size=263
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=text, val=Individual CPU Usage for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=level, val=major
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=token, val=cpu_error_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=i18n_token, val=as#system.cdm.ind_cpu_usage_above_err_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuWarning-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarning-Ind size=270
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=text, val=Individual CPU Usage for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=level, val=minor
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=token, val=cpu_warning_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=i18n_token, val=as#system.cdm.ind_cpu_usage_above_warn_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuUserError]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserError size=270
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=text, val=Average ($value_number samples) user cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=level, val=major
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=token, val=cpu_user_error
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=i18n_token, val=as#system.cdm.avrg_usr_cpu_above_err_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuUserWarning]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserWarning size=277
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=text, val=Average ($value_number samples) user cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=level, val=minor
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=token, val=cpu_user_warning
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=i18n_token, val=as#system.cdm.avrg_usr_cpu_above_warn_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuUserError-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserError-Ind size=269
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=text, val=Individual CPU User for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=level, val=major
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=token, val=cpu_user_error_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=i18n_token, val=as#system.cdm.ind_usr_cpu_above_err_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuUserWarning-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserWarning-Ind size=276
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=text, val=Individual CPU User for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=level, val=minor
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=token, val=cpu_user_warning_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=i18n_token, val=as#system.cdm.ind_usr_cpu_above_warn_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuSystemError]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemError size=276
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=text, val=Average ($value_number samples) system cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=level, val=major
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=token, val=cpu_system_error
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=i18n_token, val=as#system.cdm.avrg_sys_cpu_above_err_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuSystemWarning]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemWarning size=283
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=text, val=Average ($value_number samples) system cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=level, val=minor
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=token, val=cpu_system_warning
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=i18n_token, val=as#system.cdm.avrg_sys_cpu_above_warn_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuSystemError-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemError-Ind size=275
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=text, val=Individual CPU System for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=level, val=major
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=token, val=cpu_system_error_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=i18n_token, val=as#system.cdm.ind_cpu_sys_above_err_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuSystemWarning-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemWarning-Ind size=289
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=text, val=Individual CPU System for cpu($id) is now is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=level, val=minor
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=token, val=cpu_system_warning_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=i18n_token, val=as#system.cdm.ind_cpu_sys_above_warn_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitError]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitError size=278
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=text, val=Average ($value_number samples) IOWait cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=level, val=major
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=token, val=cpu_iowait_error
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=i18n_token, val=as#system.cdm.avrg_iowaitcpu_above_err_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitWarning]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitWarning size=285
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=text, val=Average ($value_number samples) IOWait cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=level, val=minor
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=token, val=cpu_iowait_warning
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=i18n_token, val=as#system.cdm.avrg_iowaitcpu_above_warn_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitError-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitError-Ind size=277
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=text, val=Individual CPU IOWait for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=level, val=major
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=token, val=cpu_iowait_error_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=i18n_token, val=as#system.cdm.ind_iowaitcpu_above_err_threshold
May 19 12:19:22:944 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitWarning-Ind]
May 19 12:19:22:944 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=text, val=Individual CPU IOWait for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=level, val=minor
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=token, val=cpu_iowait_warning_ind
May 19 12:19:22:944 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=i18n_token, val=as#system.cdm.ind_iowaitcpu_above_warn_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/CpuIdleError]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleError size=270
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=text, val=Average ($value_number samples) Idle cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=level, val=major
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=token, val=cpu_idle_error
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=i18n_token, val=as#system.cdm.avrg_idlecpu_above_err_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/CpuIdleWarning]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleWarning size=277
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=text, val=Average ($value_number samples) Idle cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=level, val=minor
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=token, val=cpu_idle_warning
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=i18n_token, val=as#system.cdm.avrg_idlecpu_above_warn_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/CpuIdleError-Ind]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleError-Ind size=269
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=text, val=Individual CPU Idle for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=level, val=major
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=token, val=cpu_idle_error_ind
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=i18n_token, val=as#system.cdm.ind_idlecpu_above_err_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/CpuIdleWarning-Ind]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleWarning-Ind size=276
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=text, val=Individual CPU Idle for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=level, val=minor
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=token, val=cpu_idle_warning_ind
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=i18n_token, val=as#system.cdm.ind_idlecpu_above_warn_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/CpuMultiMaxError]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/CpuMultiMaxError size=223
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=text, val=Average of single cpu (id=$max_processor_index)=$value$unit >= $value_limit$unit
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=level, val=minor
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=token, val=cpu_multi_max_error
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=i18n_token, val=as#system.cdm.arg_sngl_cpu
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/CpuMultiDiffError]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/CpuMultiDiffError size=308
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=text, val=$check_name: Difference between highest and lowest processor load (id=$max_processor_index, $min_processor_index)=$value$unit >= $value_limit$unit
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=level, val=minor
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=token, val=cpu_multi_diff_error
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=i18n_token, val=as#system.cdm.diff_highest_lowest_cpu_load
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/PagefileError]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/PagefileError size=295
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=text, val=Average ($value_number samples) memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=level, val=critical
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=token, val=pagefile_error
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=i18n_token, val=as#system.cdm.avrg_mem_usage_above_err_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=subsystem, val=
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/PagefileWarning]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/PagefileWarning size=299
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=text, val=Average ($value_number samples) memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=level, val=major
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=token, val=pagefile_warning
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=i18n_token, val=as#system.cdm.avrg_mem_usage_above_warn_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=subsystem, val=
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/PagingError]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/PagingError size=264
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=text, val=Average ($value_number samples) paging is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=level, val=major
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=token, val=paging_error
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=i18n_token, val=as#system.cdm.avrg_paging_above_err_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/PagingWarning]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/PagingWarning size=271
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=text, val=Average ($value_number samples) paging is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=level, val=minor
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=token, val=paging_warning
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=i18n_token, val=as#system.cdm.avrg_paging_above_warn_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/PhysicalWarning]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalWarning size=290
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=level, val=minor
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=token, val=physical_warning
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=i18n_token, val=as#system.cdm.avrg_phymem_above_warn_threshold
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/PhysicalWarningProcesses]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalWarningProcesses size=342
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit). Top Processes $processes
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=level, val=warning
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=token, val=physical_warning_processes
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=i18n_token, val=as#system.cdm.avrg_phymem_above_warn_threshold_proc
May 19 12:19:22:945 [7824] cluster: PdsToSection: section[/messages/SwapError]
May 19 12:19:22:945 [7824] cluster: PdsToSection - section deleted=/messages/SwapError size=272
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=text, val=Average ($value_number samples) swap memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:945 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=level, val=major
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=token, val=swap_error
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=i18n_token, val=as#system.cdm.avrg_swapmem_above_err_threshold
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/SwapWarning]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/SwapWarning size=279
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=text, val=Average ($value_number samples) swap memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=level, val=minor
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=token, val=swap_warning
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=i18n_token, val=as#system.cdm.avrg_swapmem_above_warn_threshold
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/DiskError]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/DiskError size=322
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=text, val=Average ($value_number samples) disk free on $drive is now $value$unit, which is <= error threshold ($value_limit$unit) out of total size $size_gb GB
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=level, val=critical
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=token, val=disk_error
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=i18n_token, val=as#system.cdm.avrg_drive_diskfree_below_err_threshold
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=subsystem, val=
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/DiskWarning]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/DiskWarning size=326
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=text, val=Average ($value_number samples) disk free on $drive is now $value$unit, which is <= warning threshold ($value_limit$unit) out of total size $size_gb GB
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=level, val=major
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=token, val=disk_warning
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=i18n_token, val=as#system.cdm.avrg_drive_diskfree_below_warn_threshold
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=subsystem, val=
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/InodeError]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/InodeError size=282
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=text, val=Average ($value_number samples) inodes free on $drive is now $value$unit, which is below the error threshold ($value_limit$unit)
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=level, val=major
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=token, val=inode_error
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=i18n_token, val=as#system.cdm.avrg_free_inodes_below_err_threshold
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/InodeWarning]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/InodeWarning size=289
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=text, val=Average ($value_number samples) inodes free on $drive is now $value$unit, which is below the warning threshold ($value_limit$unit)
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=level, val=minor
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=token, val=inode_warning
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=i18n_token, val=as#system.cdm.avrg_free_inodes_below_warn_threshold
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/DeltaError]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/DeltaError size=210
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=text, val=$check_name: Disk usage change on $filesys, changed by $value $unit
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=level, val=minor
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=token, val=disk_delta
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=i18n_token, val=as#system.cdm.disk_usage_changed_by_value
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/DeltaWarning]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/DeltaWarning size=214
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=text, val=$check_name: Disk usage change on $filesys, changed by $value $unit
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=level, val=warning
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=token, val=disk_delta
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=i18n_token, val=as#system.cdm.disk_usage_changed_by_value
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/DiskMissing]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/DiskMissing size=191
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=text, val=$disk_type file system $filesys is not available
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=level, val=critical
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=token, val=disk_missing
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=i18n_token, val=as#system.cdm.local_filesys_not_avl
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/DiskMounted]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/DiskMounted size=185
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=text, val=Network disk $drive ($disk) is not mounted
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=level, val=major
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=token, val=disk_mounted
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=i18n_token, val=as#system.cdm.network_disk_not_mounted
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/ConnectionError]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/ConnectionError size=186
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=text, val=Network connection error; $drive $netstatus
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=level, val=major
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=token, val=connection_error
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=i18n_token, val=as#system.cdm.network_conn_err
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/ProcQueueLen]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/ProcQueueLen size=275
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=text, val=Average ($value_number samples) processor queue length is $value$unit, which is >= $value_limit$unit. Last value is $value_last$unit.
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=level, val=minor
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=token, val=proc_q_len
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=i18n_token, val=as#system.cdm.avrg_processor_q_length
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/BootAlarm]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/BootAlarm size=201
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=text, val=$check_name: Computer has been rebooted at $boot_time
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=level, val=warning
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=subsystem, val=1.1.1
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=token, val=boot_alarm
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=i18n_token, val=as#system.cdm.comp_reboot
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/InternalAlarm]
May 19 12:19:22:946 [7824] cluster: PdsToSection - section deleted=/messages/InternalAlarm size=188
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=text, val=$check_name: $situation ($error)
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=level, val=minor
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=subsystem, val=1.1.1
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=token, val=internal_alarm
May 19 12:19:22:946 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=i18n_token, val=as#system.cdm.situation_err
May 19 12:19:22:946 [7824] cluster: PdsToSection: section[/messages/DiskRateError]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskRateError size=256
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=level, val=major
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=token, val=disk_rate_error
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=i18n_token, val=as#system.cdm.disk_rate_above_err_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/DiskRateWarning]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskRateWarning size=265
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=level, val=warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=token, val=disk_rate_warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=i18n_token, val=as#system.cdm.disk_rate_above_warn_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/DiskReadLatencyError]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskReadLatencyError size=274
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=level, val=major
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=token, val=disk_read_latency_error
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/DiskReadLatencyWarning]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskReadLatencyWarning size=283
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=level, val=warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=token, val=disk_read_latency_warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/DiskWriteLatencyWarning]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskWriteLatencyWarning size=285
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=level, val=warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=token, val=disk_write_latency_warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/DiskWriteLatencyError]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskWriteLatencyError size=276
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=level, val=major
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=token, val=disk_write_latency_error
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/DiskLatencyWarning]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskLatencyWarning size=274
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=level, val=warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=token, val=disk_latency_warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/DiskLatencyError]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/DiskLatencyError size=265
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=level, val=major
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=token, val=disk_latency_error
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/NICRateError]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/NICRateError size=251
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=level, val=major
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=token, val=nic_rate_error
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=subsystem, val=1.1.3
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=i18n_token, val=as#system.cdm.nic_rate_above_err_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/NICRateWarning]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/NICRateWarning size=260
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=level, val=warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=token, val=nic_rate_warning
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=subsystem, val=1.1.3
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=i18n_token, val=as#system.cdm.nic_rate_above_warn_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/SystemMemError]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/SystemMemError size=278
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=text, val=System memory utilization is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=level, val=major
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=token, val=system_mem_major
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=subsystem, val=1.1.1.2
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=i18n_token, val=as#system.cdm.system_memory_above_error_threshold
May 19 12:19:22:947 [7824] cluster: PdsToSection: section[/messages/SystemMemWarning]
May 19 12:19:22:947 [7824] cluster: PdsToSection - section deleted=/messages/SystemMemWarning size=286
May 19 12:19:22:947 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=text, val=System memory utilization is now $value$unit, which is >= warning threshold ($value_limit$unit)
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=level, val=warning
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=token, val=system_mem_warning
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=subsystem, val=1.1.1.2
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=i18n_token, val=as#system.cdm.system_memory_above_warning_threshold
May 19 12:19:22:948 [7824] cluster: PdsToSection: section[/messages/UserMemError]
May 19 12:19:22:948 [7824] cluster: PdsToSection - section deleted=/messages/UserMemError size=268
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=text, val=User memory utilization is now $value$unit, which is >= error threshold ($value_limit$unit)
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=level, val=major
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=token, val=user_mem_major
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=subsystem, val=1.1.1.2
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=i18n_token, val=as#system.cdm.user_memory_above_error_threshold
May 19 12:19:22:948 [7824] cluster: PdsToSection: section[/messages/UserMemWarning]
May 19 12:19:22:948 [7824] cluster: PdsToSection - section deleted=/messages/UserMemWarning size=278
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=text, val=User memory utilization is now $value$unit, which is >= warning threshold ($value_limit$unit)
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=level, val=warning
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=token, val=user_mem_warning
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=subsystem, val=1.1.1.2
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=i18n_token, val=as#system.cdm.user_memory_above_warning_threshold
May 19 12:19:22:948 [7824] cluster: PdsToSection: section[/messages/AvailableWarning]
May 19 12:19:22:948 [7824] cluster: PdsToSection - section deleted=/messages/AvailableWarning size=326
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=subsystem, val=1.1.1.2
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=i18n_token, val=as#system.cdm.available_memory_below_warning_threshold
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=text, val=Average ($value_number samples) available memory is now $value$unit, which is below the warning threshold ($value_limit$unit)
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=level, val=warning
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=token, val=available_memory_warning
May 19 12:19:22:948 [7824] cluster: PdsToSection: section[/messages/AvailableError]
May 19 12:19:22:948 [7824] cluster: PdsToSection - section deleted=/messages/AvailableError size=316
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=subsystem, val=1.1.1.2
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=i18n_token, val=as#system.cdm.available_memory_below_error_threshold
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=text, val=Average ($value_number samples) available memory is now $value$unit, which is below the error threshold ($value_limit$unit)
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=level, val=major
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=token, val=available_memory_error
May 19 12:19:22:948 [7824] cluster: PdsToSection: section[/messages/PhysicalError]
May 19 12:19:22:948 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalError size=286
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=level, val=critical
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=token, val=physical_error
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=i18n_token, val=as#system.cdm.avrg_phymem_above_err_threshold
May 19 12:19:22:948 [7824] cluster: PdsToSection: section[/messages/PhysicalErrorProcesses]
May 19 12:19:22:948 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalErrorProcesses size=336
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the error threshold ($value_limit$unit). Top Processes $processes
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=level, val=critical
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=token, val=physical_error_processes
May 19 12:19:22:948 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=i18n_token, val=as#system.cdm.avrg_phymem_above_err_threshold_proc
May 19 12:19:22:951 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:951 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:951 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:951 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:22:951 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:951 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:951 [7824] cluster: SetResourceGroupOnline - Activate profile=/cluster/FRHDGSP-APBCT40/disk
May 19 12:19:22:951 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:951 [7824] cluster: ActivateResource - probe=cdm, profile=/cluster/FRHDGSP-APBCT40/disk, file=FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:19:22:951 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:22:951 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_khpbmsyi.pds]- IN
May 19 12:19:22:963 [7824] cluster: PdsFromFile - read 1695 bytes from FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:19:22:963 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:963 [7824] cluster: PdsFromFile Size=1695
May 19 12:19:22:963 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:963 [7824] cluster: sections        PDS_PPDS       1610 
May 19 12:19:22:963 [7824] cluster: sections[0]     PDS_PPDS         45 
May 19 12:19:22:963 [7824] cluster:  __section       PDS_PCH          30 /cluster/FRHDGSP-APBCT40/disk ~
May 19 12:19:22:963 [7824] cluster: sections[1]     PDS_PPDS         51 
May 19 12:19:22:963 [7824] cluster:  __section       PDS_PCH          36 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:963 [7824] cluster: sections[2]     PDS_PPDS         57 
May 19 12:19:22:963 [7824] cluster:  __section       PDS_PCH          42 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:963 [7824] cluster: sections[3]     PDS_PPDS        483 
May 19 12:19:22:963 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:963 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:963 [7824] cluster:  description     PDS_PCH          16 File system G:\
May 19 12:19:22:963 [7824] cluster:  disk            PDS_PCH           9 tempGTBC
May 19 12:19:22:963 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:963 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:963 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:963 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:963 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:963 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:963 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:963 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:964 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:964 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:964 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:964 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:964 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:964 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:964 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:964 [7824] cluster: ActivateResource Size=1695
May 19 12:19:22:964 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:964 [7824] cluster: sections        PDS_PPDS       1610 
May 19 12:19:22:964 [7824] cluster: sections[0]     PDS_PPDS         45 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          30 /cluster/FRHDGSP-APBCT40/disk ~
May 19 12:19:22:964 [7824] cluster: sections[1]     PDS_PPDS         51 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          36 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster: sections[2]     PDS_PPDS         57 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          42 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster: sections[3]     PDS_PPDS        483 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  description     PDS_PCH          16 File system G:\
May 19 12:19:22:964 [7824] cluster:  disk            PDS_PCH           9 tempGTBC
May 19 12:19:22:964 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:22:964 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:22:964 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:22:964 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:964 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:964 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:964 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:22:964 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:22:964 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:965 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:965 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:22:965 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:22:965 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:22:965 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:965 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:965 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:22:965 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:22:965 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:22:965 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:965 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:965 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:22:965 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:22:965 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:22:965 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:965 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:22:965 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:22:965 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:22:965 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:965 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:965 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:22:965 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:22:965 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:22:965 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT40/disk/~
May 19 12:19:22:965 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:22:965 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:22:965 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:22:965 [7824] cluster: PdsToSection(): - IN
May 19 12:19:22:965 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:22:966 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk]
May 19 12:19:22:966 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk size=45
May 19 12:19:22:966 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm]
May 19 12:19:22:966 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm size=51
May 19 12:19:22:966 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed]
May 19 12:19:22:966 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed size=57
May 19 12:19:22:966 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\]
May 19 12:19:22:966 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ size=483
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=active, val=no
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=description, val=File system G:\
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=disk, val=tempGTBC
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=file_system_type, val=NTFS
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=percent, val=yes
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_disk_usage, val=no
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_disk_free, val=no
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_disk_free_perc, val=no
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_disk_total_size, val=no
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=inode_percent, val=yes
May 19 12:19:22:966 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_inode_usage, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_inode_usage_perc, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=delta_percent, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=delta_calculate_all, val=yes
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=delta_type, val=both
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_disk_delta, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ key=qos_disk_delta_perc, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/error]
May 19 12:19:22:967 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/error size=122
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/error key=active, val=yes
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/error key=threshold, val=10
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/error key=message, val=DiskError
May 19 12:19:22:967 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/warning]
May 19 12:19:22:967 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/warning size=126
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/warning key=active, val=yes
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/warning key=threshold, val=15
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/warning key=message, val=DiskWarning
May 19 12:19:22:967 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_error]
May 19 12:19:22:967 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_error size=128
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_error key=active, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_error key=threshold, val=10
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_error key=message, val=InodeError
May 19 12:19:22:967 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_warning]
May 19 12:19:22:967 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_warning size=132
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_warning key=active, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_warning key=threshold, val=20
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_warning key=message, val=InodeWarning
May 19 12:19:22:967 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/missing]
May 19 12:19:22:967 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/missing size=109
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/missing key=active, val=yes
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/missing key=message, val=DiskMissing
May 19 12:19:22:967 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_error]
May 19 12:19:22:967 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_error size=129
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_error key=active, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_error key=threshold, val=200
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_error key=message, val=DeltaError
May 19 12:19:22:967 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_warning]
May 19 12:19:22:967 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_warning size=131
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_warning key=active, val=no
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_warning key=threshold, val=8
May 19 12:19:22:967 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:22:970 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:22:970 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:22:970 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:22:970 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:22:970 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:22:970 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:22:970 [7824] cluster: SetResourceGroupOnline(): - OUT
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - group=FRHDGSP-APBCT40 is Online
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - pchMsg set Free
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - CiName set to FRHDCLI-APBCT01-FRHDGSP-APBCT40
May 19 12:19:22:970 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - Successfuly open ciOpenLocalDevice
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - Sending QoS - Group=FRHDGSP-APBCT40, state=1 (Online)
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - set QoS Sample time
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - QoS Binding Done
May 19 12:19:22:970 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:970 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:970 [7824] cluster:  data   nimid=NR94975670-08727
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - QoS Sent
May 19 12:19:22:970 [7824] cluster: MapResourceGroups - QoS un Binding Done
May 19 12:19:22:970 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56070
May 19 12:19:22:970 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:971 [7824] cluster: ciClose - [C8592B86CA0A4F9400261A0E03CEE588A]
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - local Qos and ci Closed
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - pds Deleted
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:22:971 [7824] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:22:971 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:22:971 [7824] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:22:971 [7824] cluster: FindNode() End - OUT
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:22:971 [7824] cluster: FindGroup(): - IN
May 19 12:19:22:971 [7824] cluster: FindGroup(): - OUT
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - resource group 'FRHDGSP-APBCT50' is running on cluster node 'FRHDCLI-APBCT01'
May 19 12:19:22:971 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:22:971 [7824] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:22:971 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT50 is inactive
May 19 12:19:22:971 [7824] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:19:22:971 [7824] cluster: CheckResourceGroup - resource group FRHDGSP-APBCT50 is inactive
May 19 12:19:22:971 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - (Alarm Check)Ci Name is 
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - state = 0 : Send Clear Alarm
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - Msg = Resource group 'FRHDGSP-APBCT50' is Online.Resources: 'AlertSwitchOveriSCSI Script' :Online   'Cluster Disk 5' :Online   'FRHDGSP-APBCT50' :Online   'HSC_FRHDGSP-APBCT50' :Online   'IP Address 10.27.163.144' :Online   'iSCSI Target Server' :Online   
May 19 12:19:22:971 [7824] cluster: MapResourceGroups - Token = (null)
May 19 12:19:22:971 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:22:971 [7824] cluster: ciSave - saving CI   [CB960E8C975369BEAE955A20080810175]
May 19 12:19:22:971 [7824] cluster: SendAlarm - sev=0 msg=Resource group 'FRHDGSP-APBCT50' is Online.Resources: 'AlertSwitchOveriSCSI Script' :Online   'Cluster Disk 5' :Online   'FRHDGSP-APBCT50' :Online   'HSC_FRHDGSP-APBCT50' :Online   'IP Address 10.27.163.144' :Online   'iSCSI Target Server' :Online    sup=cluster/FRHDGSP-APBCT50 src=
May 19 12:19:22:971 [7824] cluster: ciSaveMetric - saving MET [M036236387FFD6AE58CB6E047E8DC0055] 1.18:1
May 19 12:19:22:972 [7824] cluster: ciPostMessage - alarm
May 19 12:19:22:972 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:22:972 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:22:972 [7824] cluster:  data   nimid=NR94975670-08728
May 19 12:19:22:972 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56071
May 19 12:19:22:972 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:22:972 [7824] cluster: ciClose - [CB960E8C975369BEAE955A20080810175]
May 19 12:19:22:973 [7824] cluster: SetResourceGroupOnline(): - IN
May 19 12:19:22:973 [7824] cluster: SetResourceGroupOnline - FRHDGSP-APBCT50
May 19 12:19:22:973 [7824] cluster: SetResourceGroupOnline - Activate profile=/messages
May 19 12:19:22:973 [7824] cluster: ActivateResource(): - IN
May 19 12:19:22:973 [7824] cluster: ActivateResource - probe=cdm, profile=/messages, file=FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:19:22:973 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:22:973 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_svscsffi.pds]- IN
May 19 12:19:22:992 [7824] cluster: PdsFromFile - read 17669 bytes from FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:19:22:992 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:22:992 [7824] cluster: PdsFromFile Size=17669
May 19 12:19:22:992 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:992 [7824] cluster: sections        PDS_PPDS      17584 
May 19 12:19:22:992 [7824] cluster: sections[0]     PDS_PPDS         25 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          10 /messages
May 19 12:19:22:992 [7824] cluster: sections[1]     PDS_PPDS        264 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          19 /messages/CpuError
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         117 Average ($value_number samples~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          10 cpu_error
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:992 [7824] cluster: sections[2]     PDS_PPDS        271 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          21 /messages/CpuWarning
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         119 Average ($value_number samples~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          12 cpu_warning
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:992 [7824] cluster: sections[3]     PDS_PPDS        331 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuErrorProcesses
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         142 Average ($value_number samples~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          20 cpu_error_processes
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:992 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:992 [7824] cluster: sections[4]     PDS_PPDS        335 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          30 /messages/CpuWarningProcesses ~
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         144 Average ($value_number samples~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          22 cpu_warning_processes
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:992 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:992 [7824] cluster: sections[5]     PDS_PPDS        263 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuError-Ind
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         109 Individual CPU Usage for cpu($~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          14 cpu_error_ind
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:992 [7824] cluster: sections[6]     PDS_PPDS        270 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuWarning-Ind
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         111 Individual CPU Usage for cpu($~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          16 cpu_warning_ind
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:992 [7824] cluster: sections[7]     PDS_PPDS        270 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuUserError
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          15 cpu_user_error
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:992 [7824] cluster: sections[8]     PDS_PPDS        277 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuUserWarning
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          17 cpu_user_warning
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:992 [7824] cluster: sections[9]     PDS_PPDS        269 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuUserError-Ind
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         108 Individual CPU User for cpu($i~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          19 cpu_user_error_ind
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:992 [7824] cluster: sections[10]    PDS_PPDS        276 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuUserWarning-Ind
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         110 Individual CPU User for cpu($i~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          21 cpu_user_warning_ind
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:992 [7824] cluster: sections[11]    PDS_PPDS        276 
May 19 12:19:22:992 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuSystemError
May 19 12:19:22:992 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:992 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:992 [7824] cluster:  token           PDS_PCH          17 cpu_system_error
May 19 12:19:22:992 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:992 [7824] cluster: sections[12]    PDS_PPDS        283 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuSystemWarning
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          19 cpu_system_warning
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:993 [7824] cluster: sections[13]    PDS_PPDS        275 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuSystemError-Ind
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         110 Individual CPU System for cpu(~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          21 cpu_system_error_ind
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:993 [7824] cluster: sections[14]    PDS_PPDS        289 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuSystemWarning-Ind~
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         119 Individual CPU System for cpu(~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          23 cpu_system_warning_ind
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:993 [7824] cluster: sections[15]    PDS_PPDS        278 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIOWaitError
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          17 cpu_iowait_error
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:993 [7824] cluster: sections[16]    PDS_PPDS        285 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIOWaitWarning
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          19 cpu_iowait_warning
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:993 [7824] cluster: sections[17]    PDS_PPDS        277 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIOWaitError-Ind
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         110 Individual CPU IOWait for cpu(~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          21 cpu_iowait_error_ind
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:993 [7824] cluster: sections[18]    PDS_PPDS        284 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuIOWaitWarning-Ind~
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         112 Individual CPU IOWait for cpu(~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          23 cpu_iowait_warning_ind
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:993 [7824] cluster: sections[19]    PDS_PPDS        270 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuIdleError
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          15 cpu_idle_error
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:993 [7824] cluster: sections[20]    PDS_PPDS        277 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIdleWarning
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          17 cpu_idle_warning
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:993 [7824] cluster: sections[21]    PDS_PPDS        269 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIdleError-Ind
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         108 Individual CPU Idle for cpu($i~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          19 cpu_idle_error_ind
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:993 [7824] cluster: sections[22]    PDS_PPDS        276 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIdleWarning-Ind
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         110 Individual CPU Idle for cpu($i~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          21 cpu_idle_warning_ind
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:993 [7824] cluster: sections[23]    PDS_PPDS        223 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuMultiMaxError
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH          81 Average of single cpu (id=$max~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          20 cpu_multi_max_error
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          27 as#system.cdm.arg_sngl_cpu
May 19 12:19:22:993 [7824] cluster: sections[24]    PDS_PPDS        308 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuMultiDiffError
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         147 $check_name: Difference betwee~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          21 cpu_multi_diff_error
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.diff_highest_low~
May 19 12:19:22:993 [7824] cluster: sections[25]    PDS_PPDS        295 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          24 /messages/PagefileError
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:993 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:993 [7824] cluster:  token           PDS_PCH          15 pagefile_error
May 19 12:19:22:993 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:993 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:993 [7824] cluster: sections[26]    PDS_PPDS        299 
May 19 12:19:22:993 [7824] cluster:  __section       PDS_PCH          26 /messages/PagefileWarning
May 19 12:19:22:993 [7824] cluster:  text            PDS_PCH         122 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          17 pagefile_warning
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:994 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:994 [7824] cluster: sections[27]    PDS_PPDS        264 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          22 /messages/PagingError
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         114 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          13 paging_error
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:994 [7824] cluster: sections[28]    PDS_PPDS        271 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          24 /messages/PagingWarning
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          15 paging_warning
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:994 [7824] cluster: sections[29]    PDS_PPDS        290 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          26 /messages/PhysicalWarning
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          17 physical_warning
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:994 [7824] cluster: sections[30]    PDS_PPDS        342 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          35 /messages/PhysicalWarningProce~
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         157 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          27 physical_warning_processes
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:994 [7824] cluster: sections[31]    PDS_PPDS        272 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          20 /messages/SwapError
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         125 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          11 swap_error
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:994 [7824] cluster: sections[32]    PDS_PPDS        279 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          22 /messages/SwapWarning
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         127 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          13 swap_warning
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:994 [7824] cluster: sections[33]    PDS_PPDS        322 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          20 /messages/DiskError
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         150 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          11 disk_error
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:994 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:994 [7824] cluster: sections[34]    PDS_PPDS        326 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskWarning
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         152 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          13 disk_warning
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:994 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:994 [7824] cluster: sections[35]    PDS_PPDS        282 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          21 /messages/InodeError
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          12 inode_error
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:994 [7824] cluster: sections[36]    PDS_PPDS        289 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          23 /messages/InodeWarning
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          14 inode_warning
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:994 [7824] cluster: sections[37]    PDS_PPDS        210 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          21 /messages/DeltaError
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:994 [7824] cluster: sections[38]    PDS_PPDS        214 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          23 /messages/DeltaWarning
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:994 [7824] cluster: sections[39]    PDS_PPDS        191 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMissing
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH          49 $disk_type file system $filesy~
May 19 12:19:22:994 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:994 [7824] cluster:  token           PDS_PCH          13 disk_missing
May 19 12:19:22:994 [7824] cluster:  i18n_token      PDS_PCH          36 as#system.cdm.local_filesys_no~
May 19 12:19:22:994 [7824] cluster: sections[40]    PDS_PPDS        185 
May 19 12:19:22:994 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMounted
May 19 12:19:22:994 [7824] cluster:  text            PDS_PCH          43 Network disk $drive ($disk) is~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          13 disk_mounted
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          39 as#system.cdm.network_disk_not~
May 19 12:19:22:995 [7824] cluster: sections[41]    PDS_PPDS        186 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          26 /messages/ConnectionError
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          44 Network connection error; $dri~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          17 connection_error
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          31 as#system.cdm.network_conn_err~
May 19 12:19:22:995 [7824] cluster: sections[42]    PDS_PPDS        275 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          23 /messages/ProcQueueLen
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH         134 Average ($value_number samples~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          11 proc_q_len
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          38 as#system.cdm.avrg_processor_q~
May 19 12:19:22:995 [7824] cluster: sections[43]    PDS_PPDS        201 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          20 /messages/BootAlarm
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          54 $check_name: Computer has been~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          11 boot_alarm
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          26 as#system.cdm.comp_reboot
May 19 12:19:22:995 [7824] cluster: sections[44]    PDS_PPDS        188 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          24 /messages/InternalAlarm
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          33 $check_name: $situation ($erro~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          15 internal_alarm
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          28 as#system.cdm.situation_err
May 19 12:19:22:995 [7824] cluster: sections[45]    PDS_PPDS        256 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          24 /messages/DiskRateError
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          16 disk_rate_error
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.disk_rate_above_~
May 19 12:19:22:995 [7824] cluster: sections[46]    PDS_PPDS        265 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          26 /messages/DiskRateWarning
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          18 disk_rate_warning
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          45 as#system.cdm.disk_rate_above_~
May 19 12:19:22:995 [7824] cluster: sections[47]    PDS_PPDS        274 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          31 /messages/DiskReadLatencyError~
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          24 disk_read_latency_error
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:995 [7824] cluster: sections[48]    PDS_PPDS        283 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          33 /messages/DiskReadLatencyWarni~
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          26 disk_read_latency_warning
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:995 [7824] cluster: sections[49]    PDS_PPDS        285 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          34 /messages/DiskWriteLatencyWarn~
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          27 disk_write_latency_warning
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:995 [7824] cluster: sections[50]    PDS_PPDS        276 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          32 /messages/DiskWriteLatencyErro~
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          25 disk_write_latency_error
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:995 [7824] cluster: sections[51]    PDS_PPDS        274 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          29 /messages/DiskLatencyWarning
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          21 disk_latency_warning
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:22:995 [7824] cluster: sections[52]    PDS_PPDS        265 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          27 /messages/DiskLatencyError
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:995 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:995 [7824] cluster:  token           PDS_PCH          19 disk_latency_error
May 19 12:19:22:995 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:22:995 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:22:995 [7824] cluster: sections[53]    PDS_PPDS        251 
May 19 12:19:22:995 [7824] cluster:  __section       PDS_PCH          23 /messages/NICRateError
May 19 12:19:22:995 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          15 nic_rate_error
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.nic_rate_above_e~
May 19 12:19:22:996 [7824] cluster: sections[54]    PDS_PPDS        260 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          25 /messages/NICRateWarning
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          17 nic_rate_warning
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.nic_rate_above_w~
May 19 12:19:22:996 [7824] cluster: sections[55]    PDS_PPDS        278 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          25 /messages/SystemMemError
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          17 system_mem_major
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.system_memory_ab~
May 19 12:19:22:996 [7824] cluster: sections[56]    PDS_PPDS        286 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          27 /messages/SystemMemWarning
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          19 system_mem_warning
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.system_memory_ab~
May 19 12:19:22:996 [7824] cluster: sections[57]    PDS_PPDS        268 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          23 /messages/UserMemError
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH          92 User memory utilization is now~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          15 user_mem_major
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.user_memory_abov~
May 19 12:19:22:996 [7824] cluster: sections[58]    PDS_PPDS        278 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          25 /messages/UserMemWarning
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH          94 User memory utilization is now~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          17 user_mem_warning
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.user_memory_abov~
May 19 12:19:22:996 [7824] cluster: sections[59]    PDS_PPDS        326 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          27 /messages/AvailableWarning
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.available_memory~
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH         126 Average ($value_number samples~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          25 available_memory_warning
May 19 12:19:22:996 [7824] cluster: sections[60]    PDS_PPDS        316 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          25 /messages/AvailableError
May 19 12:19:22:996 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          53 as#system.cdm.available_memory~
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH         124 Average ($value_number samples~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          23 available_memory_error
May 19 12:19:22:996 [7824] cluster: sections[61]    PDS_PPDS        286 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          24 /messages/PhysicalError
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          15 physical_error
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:996 [7824] cluster: sections[62]    PDS_PPDS        336 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          33 /messages/PhysicalErrorProcess~
May 19 12:19:22:996 [7824] cluster:  text            PDS_PCH         155 Average ($value_number samples~
May 19 12:19:22:996 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:996 [7824] cluster:  token           PDS_PCH          25 physical_error_processes
May 19 12:19:22:996 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:996 [7824] cluster: ActivateResource Size=17669
May 19 12:19:22:996 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:22:996 [7824] cluster: sections        PDS_PPDS      17584 
May 19 12:19:22:996 [7824] cluster: sections[0]     PDS_PPDS         25 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          10 /messages
May 19 12:19:22:996 [7824] cluster: sections[1]     PDS_PPDS        264 
May 19 12:19:22:996 [7824] cluster:  __section       PDS_PCH          19 /messages/CpuError
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         117 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          10 cpu_error
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:997 [7824] cluster: sections[2]     PDS_PPDS        271 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          21 /messages/CpuWarning
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         119 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          12 cpu_warning
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:997 [7824] cluster: sections[3]     PDS_PPDS        331 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuErrorProcesses
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         142 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          20 cpu_error_processes
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:997 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:997 [7824] cluster: sections[4]     PDS_PPDS        335 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          30 /messages/CpuWarningProcesses ~
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         144 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          22 cpu_warning_processes
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_total_cpu_a~
May 19 12:19:22:997 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:997 [7824] cluster: sections[5]     PDS_PPDS        263 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuError-Ind
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         109 Individual CPU Usage for cpu($~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          14 cpu_error_ind
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:997 [7824] cluster: sections[6]     PDS_PPDS        270 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuWarning-Ind
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         111 Individual CPU Usage for cpu($~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          16 cpu_warning_ind
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_cpu_usage_ab~
May 19 12:19:22:997 [7824] cluster: sections[7]     PDS_PPDS        270 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuUserError
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          15 cpu_user_error
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:997 [7824] cluster: sections[8]     PDS_PPDS        277 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuUserWarning
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          17 cpu_user_warning
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_usr_cpu_abo~
May 19 12:19:22:997 [7824] cluster: sections[9]     PDS_PPDS        269 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuUserError-Ind
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         108 Individual CPU User for cpu($i~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          19 cpu_user_error_ind
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:997 [7824] cluster: sections[10]    PDS_PPDS        276 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuUserWarning-Ind
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         110 Individual CPU User for cpu($i~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          21 cpu_user_warning_ind
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_usr_cpu_abov~
May 19 12:19:22:997 [7824] cluster: sections[11]    PDS_PPDS        276 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuSystemError
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          17 cpu_system_error
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:997 [7824] cluster: sections[12]    PDS_PPDS        283 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuSystemWarning
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          19 cpu_system_warning
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_sys_cpu_abo~
May 19 12:19:22:997 [7824] cluster: sections[13]    PDS_PPDS        275 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuSystemError-Ind
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         110 Individual CPU System for cpu(~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          21 cpu_system_error_ind
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:997 [7824] cluster: sections[14]    PDS_PPDS        289 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuSystemWarning-Ind~
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         119 Individual CPU System for cpu(~
May 19 12:19:22:997 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:997 [7824] cluster:  token           PDS_PCH          23 cpu_system_warning_ind
May 19 12:19:22:997 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_cpu_sys_abov~
May 19 12:19:22:997 [7824] cluster: sections[15]    PDS_PPDS        278 
May 19 12:19:22:997 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIOWaitError
May 19 12:19:22:997 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          17 cpu_iowait_error
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:998 [7824] cluster: sections[16]    PDS_PPDS        285 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIOWaitWarning
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          19 cpu_iowait_warning
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_iowaitcpu_a~
May 19 12:19:22:998 [7824] cluster: sections[17]    PDS_PPDS        277 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIOWaitError-Ind
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         110 Individual CPU IOWait for cpu(~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          21 cpu_iowait_error_ind
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:998 [7824] cluster: sections[18]    PDS_PPDS        284 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          31 /messages/CpuIOWaitWarning-Ind~
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         112 Individual CPU IOWait for cpu(~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          23 cpu_iowait_warning_ind
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.ind_iowaitcpu_ab~
May 19 12:19:22:998 [7824] cluster: sections[19]    PDS_PPDS        270 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          23 /messages/CpuIdleError
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          15 cpu_idle_error
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:998 [7824] cluster: sections[20]    PDS_PPDS        277 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          25 /messages/CpuIdleWarning
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         118 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          17 cpu_idle_warning
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_idlecpu_abo~
May 19 12:19:22:998 [7824] cluster: sections[21]    PDS_PPDS        269 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuIdleError-Ind
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         108 Individual CPU Idle for cpu($i~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          19 cpu_idle_error_ind
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:998 [7824] cluster: sections[22]    PDS_PPDS        276 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          29 /messages/CpuIdleWarning-Ind
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         110 Individual CPU Idle for cpu($i~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          21 cpu_idle_warning_ind
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.ind_idlecpu_abov~
May 19 12:19:22:998 [7824] cluster: sections[23]    PDS_PPDS        223 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          27 /messages/CpuMultiMaxError
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH          81 Average of single cpu (id=$max~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          20 cpu_multi_max_error
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          27 as#system.cdm.arg_sngl_cpu
May 19 12:19:22:998 [7824] cluster: sections[24]    PDS_PPDS        308 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          28 /messages/CpuMultiDiffError
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         147 $check_name: Difference betwee~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          21 cpu_multi_diff_error
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.diff_highest_low~
May 19 12:19:22:998 [7824] cluster: sections[25]    PDS_PPDS        295 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          24 /messages/PagefileError
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         120 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          15 pagefile_error
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          49 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:998 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:998 [7824] cluster: sections[26]    PDS_PPDS        299 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          26 /messages/PagefileWarning
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         122 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          17 pagefile_warning
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.avrg_mem_usage_a~
May 19 12:19:22:998 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:998 [7824] cluster: sections[27]    PDS_PPDS        264 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          22 /messages/PagingError
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         114 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          13 paging_error
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:998 [7824] cluster: sections[28]    PDS_PPDS        271 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          24 /messages/PagingWarning
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         116 Average ($value_number samples~
May 19 12:19:22:998 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:998 [7824] cluster:  token           PDS_PCH          15 paging_warning
May 19 12:19:22:998 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_paging_abov~
May 19 12:19:22:998 [7824] cluster: sections[29]    PDS_PPDS        290 
May 19 12:19:22:998 [7824] cluster:  __section       PDS_PCH          26 /messages/PhysicalWarning
May 19 12:19:22:998 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          17 physical_warning
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:999 [7824] cluster: sections[30]    PDS_PPDS        342 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          35 /messages/PhysicalWarningProce~
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH         157 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          27 physical_warning_processes
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_phymem_abov~
May 19 12:19:22:999 [7824] cluster: sections[31]    PDS_PPDS        272 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          20 /messages/SwapError
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH         125 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          11 swap_error
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:999 [7824] cluster: sections[32]    PDS_PPDS        279 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          22 /messages/SwapWarning
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH         127 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          13 swap_warning
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.avrg_swapmem_abo~
May 19 12:19:22:999 [7824] cluster: sections[33]    PDS_PPDS        322 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          20 /messages/DiskError
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH         150 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          11 disk_error
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          54 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:999 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:999 [7824] cluster: sections[34]    PDS_PPDS        326 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskWarning
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH         152 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          13 disk_warning
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.avrg_drive_diskf~
May 19 12:19:22:999 [7824] cluster:  subsystem       PDS_PCH           1 
May 19 12:19:22:999 [7824] cluster: sections[35]    PDS_PPDS        282 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          21 /messages/InodeError
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          12 inode_error
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:999 [7824] cluster: sections[36]    PDS_PPDS        289 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          23 /messages/InodeWarning
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH         131 Average ($value_number samples~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          14 inode_warning
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.avrg_free_inodes~
May 19 12:19:22:999 [7824] cluster: sections[37]    PDS_PPDS        210 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          21 /messages/DeltaError
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:999 [7824] cluster: sections[38]    PDS_PPDS        214 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          23 /messages/DeltaWarning
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH          68 $check_name: Disk usage change~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          11 disk_delta
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          42 as#system.cdm.disk_usage_chang~
May 19 12:19:22:999 [7824] cluster: sections[39]    PDS_PPDS        191 
May 19 12:19:22:999 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMissing
May 19 12:19:22:999 [7824] cluster:  text            PDS_PCH          49 $disk_type file system $filesy~
May 19 12:19:22:999 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:22:999 [7824] cluster:  token           PDS_PCH          13 disk_missing
May 19 12:19:22:999 [7824] cluster:  i18n_token      PDS_PCH          36 as#system.cdm.local_filesys_no~
May 19 12:19:23:000 [7824] cluster: sections[40]    PDS_PPDS        185 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          22 /messages/DiskMounted
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          43 Network disk $drive ($disk) is~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          13 disk_mounted
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          39 as#system.cdm.network_disk_not~
May 19 12:19:23:000 [7824] cluster: sections[41]    PDS_PPDS        186 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          26 /messages/ConnectionError
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          44 Network connection error; $dri~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          17 connection_error
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          31 as#system.cdm.network_conn_err~
May 19 12:19:23:000 [7824] cluster: sections[42]    PDS_PPDS        275 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          23 /messages/ProcQueueLen
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH         134 Average ($value_number samples~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          11 proc_q_len
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          38 as#system.cdm.avrg_processor_q~
May 19 12:19:23:000 [7824] cluster: sections[43]    PDS_PPDS        201 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          20 /messages/BootAlarm
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          54 $check_name: Computer has been~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          11 boot_alarm
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          26 as#system.cdm.comp_reboot
May 19 12:19:23:000 [7824] cluster: sections[44]    PDS_PPDS        188 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          24 /messages/InternalAlarm
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          33 $check_name: $situation ($erro~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 minor
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           6 1.1.1
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          15 internal_alarm
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          28 as#system.cdm.situation_err
May 19 12:19:23:000 [7824] cluster: sections[45]    PDS_PPDS        256 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          24 /messages/DiskRateError
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          16 disk_rate_error
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.disk_rate_above_~
May 19 12:19:23:000 [7824] cluster: sections[46]    PDS_PPDS        265 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          26 /messages/DiskRateWarning
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          18 disk_rate_warning
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          45 as#system.cdm.disk_rate_above_~
May 19 12:19:23:000 [7824] cluster: sections[47]    PDS_PPDS        274 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          31 /messages/DiskReadLatencyError~
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          24 disk_read_latency_error
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:23:000 [7824] cluster: sections[48]    PDS_PPDS        283 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          33 /messages/DiskReadLatencyWarni~
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          26 disk_read_latency_warning
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:23:000 [7824] cluster: sections[49]    PDS_PPDS        285 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          34 /messages/DiskWriteLatencyWarn~
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          27 disk_write_latency_warning
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:23:000 [7824] cluster: sections[50]    PDS_PPDS        276 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          32 /messages/DiskWriteLatencyErro~
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          25 disk_write_latency_error
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:23:000 [7824] cluster: sections[51]    PDS_PPDS        274 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          29 /messages/DiskLatencyWarning
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          21 disk_latency_warning
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:000 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.disk_latency_abo~
May 19 12:19:23:000 [7824] cluster: sections[52]    PDS_PPDS        265 
May 19 12:19:23:000 [7824] cluster:  __section       PDS_PCH          27 /messages/DiskLatencyError
May 19 12:19:23:000 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:23:000 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:000 [7824] cluster:  token           PDS_PCH          19 disk_latency_error
May 19 12:19:23:000 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.1
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          47 as#system.cdm.disk_latency_abo~
May 19 12:19:23:001 [7824] cluster: sections[53]    PDS_PPDS        251 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          23 /messages/NICRateError
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH          82 $check_name is now $value $uni~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          15 nic_rate_error
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          43 as#system.cdm.nic_rate_above_e~
May 19 12:19:23:001 [7824] cluster: sections[54]    PDS_PPDS        260 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          25 /messages/NICRateWarning
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH          84 $check_name is now $value $uni~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          17 nic_rate_warning
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           6 1.1.3
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          44 as#system.cdm.nic_rate_above_w~
May 19 12:19:23:001 [7824] cluster: sections[55]    PDS_PPDS        278 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          25 /messages/SystemMemError
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          17 system_mem_major
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.system_memory_ab~
May 19 12:19:23:001 [7824] cluster: sections[56]    PDS_PPDS        286 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          27 /messages/SystemMemWarning
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH          96 System memory utilization is n~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          19 system_mem_warning
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          52 as#system.cdm.system_memory_ab~
May 19 12:19:23:001 [7824] cluster: sections[57]    PDS_PPDS        268 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          23 /messages/UserMemError
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH          92 User memory utilization is now~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          15 user_mem_major
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          48 as#system.cdm.user_memory_abov~
May 19 12:19:23:001 [7824] cluster: sections[58]    PDS_PPDS        278 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          25 /messages/UserMemWarning
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH          94 User memory utilization is now~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          17 user_mem_warning
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          50 as#system.cdm.user_memory_abov~
May 19 12:19:23:001 [7824] cluster: sections[59]    PDS_PPDS        326 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          27 /messages/AvailableWarning
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          55 as#system.cdm.available_memory~
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH         126 Average ($value_number samples~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           8 warning
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          25 available_memory_warning
May 19 12:19:23:001 [7824] cluster: sections[60]    PDS_PPDS        316 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          25 /messages/AvailableError
May 19 12:19:23:001 [7824] cluster:  subsystem       PDS_PCH           8 1.1.1.2
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          53 as#system.cdm.available_memory~
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH         124 Average ($value_number samples~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           6 major
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          23 available_memory_error
May 19 12:19:23:001 [7824] cluster: sections[61]    PDS_PPDS        286 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          24 /messages/PhysicalError
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH         129 Average ($value_number samples~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          15 physical_error
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          46 as#system.cdm.avrg_phymem_abov~
May 19 12:19:23:001 [7824] cluster: sections[62]    PDS_PPDS        336 
May 19 12:19:23:001 [7824] cluster:  __section       PDS_PCH          33 /messages/PhysicalErrorProcess~
May 19 12:19:23:001 [7824] cluster:  text            PDS_PCH         155 Average ($value_number samples~
May 19 12:19:23:001 [7824] cluster:  level           PDS_PCH           9 critical
May 19 12:19:23:001 [7824] cluster:  token           PDS_PCH          25 physical_error_processes
May 19 12:19:23:001 [7824] cluster:  i18n_token      PDS_PCH          51 as#system.cdm.avrg_phymem_abov~
May 19 12:19:23:001 [7824] cluster: PdsToSection(): - IN
May 19 12:19:23:001 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages size=25
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuError]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuError size=264
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=level, val=major
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=token, val=cpu_error
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_err_threshold
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuWarning]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarning size=271
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=level, val=minor
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=token, val=cpu_warning
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_warn_threshold
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuErrorProcesses]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuErrorProcesses size=331
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the error threshold ($value_limit$unit).Top Processes $processes
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=level, val=critical
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=token, val=cpu_error_processes
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_err_threshold_proc
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuErrorProcesses key=subsystem, val=
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuWarningProcesses]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarningProcesses size=335
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=text, val=Average ($value_number samples) total cpu is now $value$unit, which is above the warning threshold ($value_limit$unit).Top Processes $processes
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=level, val=major
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=token, val=cpu_warning_processes
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=i18n_token, val=as#system.cdm.avrg_total_cpu_above_warn_threshold_proc
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarningProcesses key=subsystem, val=
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuError-Ind]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuError-Ind size=263
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=text, val=Individual CPU Usage for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=level, val=major
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuError-Ind]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuError-Ind size=263
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=text, val=Individual CPU Usage for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=level, val=major
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=token, val=cpu_error_ind
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuError-Ind key=i18n_token, val=as#system.cdm.ind_cpu_usage_above_err_threshold
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuWarning-Ind]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuWarning-Ind size=270
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=text, val=Individual CPU Usage for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=level, val=minor
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=token, val=cpu_warning_ind
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuWarning-Ind key=i18n_token, val=as#system.cdm.ind_cpu_usage_above_warn_threshold
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuUserError]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserError size=270
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=text, val=Average ($value_number samples) user cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=level, val=major
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=token, val=cpu_user_error
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError key=i18n_token, val=as#system.cdm.avrg_usr_cpu_above_err_threshold
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuUserWarning]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserWarning size=277
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=text, val=Average ($value_number samples) user cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=level, val=minor
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=token, val=cpu_user_warning
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning key=i18n_token, val=as#system.cdm.avrg_usr_cpu_above_warn_threshold
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuUserError-Ind]
May 19 12:19:23:003 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserError-Ind size=269
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=text, val=Individual CPU User for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=level, val=major
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=token, val=cpu_user_error_ind
May 19 12:19:23:003 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserError-Ind key=i18n_token, val=as#system.cdm.ind_usr_cpu_above_err_threshold
May 19 12:19:23:003 [7824] cluster: PdsToSection: section[/messages/CpuUserWarning-Ind]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuUserWarning-Ind size=276
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=text, val=Individual CPU User for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=level, val=minor
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=token, val=cpu_user_warning_ind
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuUserWarning-Ind key=i18n_token, val=as#system.cdm.ind_usr_cpu_above_warn_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuSystemError]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemError size=276
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=text, val=Average ($value_number samples) system cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=level, val=major
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=token, val=cpu_system_error
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError key=i18n_token, val=as#system.cdm.avrg_sys_cpu_above_err_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuSystemWarning]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemWarning size=283
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=text, val=Average ($value_number samples) system cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=level, val=minor
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=token, val=cpu_system_warning
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning key=i18n_token, val=as#system.cdm.avrg_sys_cpu_above_warn_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuSystemError-Ind]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemError-Ind size=275
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=text, val=Individual CPU System for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=level, val=major
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=token, val=cpu_system_error_ind
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemError-Ind key=i18n_token, val=as#system.cdm.ind_cpu_sys_above_err_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuSystemWarning-Ind]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuSystemWarning-Ind size=289
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=text, val=Individual CPU System for cpu($id) is now is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=level, val=minor
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=token, val=cpu_system_warning_ind
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuSystemWarning-Ind key=i18n_token, val=as#system.cdm.ind_cpu_sys_above_warn_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitError]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitError size=278
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=text, val=Average ($value_number samples) IOWait cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=level, val=major
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=token, val=cpu_iowait_error
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError key=i18n_token, val=as#system.cdm.avrg_iowaitcpu_above_err_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitWarning]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitWarning size=285
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=text, val=Average ($value_number samples) IOWait cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=level, val=minor
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=token, val=cpu_iowait_warning
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning key=i18n_token, val=as#system.cdm.avrg_iowaitcpu_above_warn_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitError-Ind]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitError-Ind size=277
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=text, val=Individual CPU IOWait for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=level, val=major
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=token, val=cpu_iowait_error_ind
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitError-Ind key=i18n_token, val=as#system.cdm.ind_iowaitcpu_above_err_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIOWaitWarning-Ind]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=text, val=Individual CPU IOWait for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=level, val=minor
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=token, val=cpu_iowait_warning_ind
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIOWaitWarning-Ind key=i18n_token, val=as#system.cdm.ind_iowaitcpu_above_warn_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIdleError]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleError size=270
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=text, val=Average ($value_number samples) Idle cpu is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=level, val=major
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=token, val=cpu_idle_error
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError key=i18n_token, val=as#system.cdm.avrg_idlecpu_above_err_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIdleWarning]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleWarning size=277
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=text, val=Average ($value_number samples) Idle cpu is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=level, val=minor
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=token, val=cpu_idle_warning
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning key=i18n_token, val=as#system.cdm.avrg_idlecpu_above_warn_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIdleError-Ind]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleError-Ind size=269
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=text, val=Individual CPU Idle for cpu($id) is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=level, val=major
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=token, val=cpu_idle_error_ind
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleError-Ind key=i18n_token, val=as#system.cdm.ind_idlecpu_above_err_threshold
May 19 12:19:23:004 [7824] cluster: PdsToSection: section[/messages/CpuIdleWarning-Ind]
May 19 12:19:23:004 [7824] cluster: PdsToSection - section deleted=/messages/CpuIdleWarning-Ind size=276
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=text, val=Individual CPU Idle for cpu($id) is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:004 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=level, val=minor
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=token, val=cpu_idle_warning_ind
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuIdleWarning-Ind key=i18n_token, val=as#system.cdm.ind_idlecpu_above_warn_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/CpuMultiMaxError]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/CpuMultiMaxError size=223
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=text, val=Average of single cpu (id=$max_processor_index)=$value$unit >= $value_limit$unit
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=level, val=minor
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=token, val=cpu_multi_max_error
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiMaxError key=i18n_token, val=as#system.cdm.arg_sngl_cpu
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/CpuMultiDiffError]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/CpuMultiDiffError size=308
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=text, val=$check_name: Difference between highest and lowest processor load (id=$max_processor_index, $min_processor_index)=$value$unit >= $value_limit$unit
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=level, val=minor
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=token, val=cpu_multi_diff_error
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/CpuMultiDiffError key=i18n_token, val=as#system.cdm.diff_highest_lowest_cpu_load
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/PagefileError]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/PagefileError size=295
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=text, val=Average ($value_number samples) memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=level, val=critical
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=token, val=pagefile_error
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=i18n_token, val=as#system.cdm.avrg_mem_usage_above_err_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileError key=subsystem, val=
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/PagefileWarning]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/PagefileWarning size=299
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=text, val=Average ($value_number samples) memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=level, val=major
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=token, val=pagefile_warning
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=i18n_token, val=as#system.cdm.avrg_mem_usage_above_warn_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagefileWarning key=subsystem, val=
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/PagingError]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/PagingError size=264
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=text, val=Average ($value_number samples) paging is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=level, val=major
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=token, val=paging_error
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingError key=i18n_token, val=as#system.cdm.avrg_paging_above_err_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/PagingWarning]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/PagingWarning size=271
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=text, val=Average ($value_number samples) paging is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=level, val=minor
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=token, val=paging_warning
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PagingWarning key=i18n_token, val=as#system.cdm.avrg_paging_above_warn_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/PhysicalWarning]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalWarning size=290
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=level, val=minor
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=token, val=physical_warning
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarning key=i18n_token, val=as#system.cdm.avrg_phymem_above_warn_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/PhysicalWarningProcesses]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalWarningProcesses size=342
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit). Top Processes $processes
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=level, val=warning
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=token, val=physical_warning_processes
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalWarningProcesses key=i18n_token, val=as#system.cdm.avrg_phymem_above_warn_threshold_proc
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/SwapError]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/SwapError size=272
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=text, val=Average ($value_number samples) swap memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=level, val=major
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=token, val=swap_error
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapError key=i18n_token, val=as#system.cdm.avrg_swapmem_above_err_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/SwapWarning]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/SwapWarning size=279
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=text, val=Average ($value_number samples) swap memory usage is now $value$unit, which is above the warning threshold ($value_limit$unit)
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=level, val=minor
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=token, val=swap_warning
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SwapWarning key=i18n_token, val=as#system.cdm.avrg_swapmem_above_warn_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection: section[/messages/DiskError]
May 19 12:19:23:005 [7824] cluster: PdsToSection - section deleted=/messages/DiskError size=322
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=text, val=Average ($value_number samples) disk free on $drive is now $value$unit, which is <= error threshold ($value_limit$unit) out of total size $size_gb GB
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=level, val=critical
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=token, val=disk_error
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=i18n_token, val=as#system.cdm.avrg_drive_diskfree_below_err_threshold
May 19 12:19:23:005 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskError key=subsystem, val=
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/DiskWarning]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/DiskWarning size=326
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=text, val=Average ($value_number samples) disk free on $drive is now $value$unit, which is <= warning threshold ($value_limit$unit) out of total size $size_gb GB
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=level, val=major
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=token, val=disk_warning
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=i18n_token, val=as#system.cdm.avrg_drive_diskfree_below_warn_threshold
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWarning key=subsystem, val=
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/InodeError]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/InodeError size=282
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=text, val=Average ($value_number samples) inodes free on $drive is now $value$unit, which is below the error threshold ($value_limit$unit)
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=level, val=major
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=token, val=inode_error
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeError key=i18n_token, val=as#system.cdm.avrg_free_inodes_below_err_threshold
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/InodeWarning]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/InodeWarning size=289
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=text, val=Average ($value_number samples) inodes free on $drive is now $value$unit, which is below the warning threshold ($value_limit$unit)
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=level, val=minor
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=token, val=inode_warning
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InodeWarning key=i18n_token, val=as#system.cdm.avrg_free_inodes_below_warn_threshold
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/DeltaError]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/DeltaError size=210
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=text, val=$check_name: Disk usage change on $filesys, changed by $value $unit
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=level, val=minor
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=token, val=disk_delta
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaError key=i18n_token, val=as#system.cdm.disk_usage_changed_by_value
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/DeltaWarning]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/DeltaWarning size=214
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=text, val=$check_name: Disk usage change on $filesys, changed by $value $unit
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=level, val=warning
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=token, val=disk_delta
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DeltaWarning key=i18n_token, val=as#system.cdm.disk_usage_changed_by_value
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/DiskMissing]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/DiskMissing size=191
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=text, val=$disk_type file system $filesys is not available
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=level, val=critical
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=token, val=disk_missing
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMissing key=i18n_token, val=as#system.cdm.local_filesys_not_avl
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/DiskMounted]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/DiskMounted size=185
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=text, val=Network disk $drive ($disk) is not mounted
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=level, val=major
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=token, val=disk_mounted
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskMounted key=i18n_token, val=as#system.cdm.network_disk_not_mounted
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/ConnectionError]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/ConnectionError size=186
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=text, val=Network connection error; $drive $netstatus
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=level, val=major
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=token, val=connection_error
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ConnectionError key=i18n_token, val=as#system.cdm.network_conn_err
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/ProcQueueLen]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/ProcQueueLen size=275
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=text, val=Average ($value_number samples) processor queue length is $value$unit, which is >= $value_limit$unit. Last value is $value_last$unit.
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=level, val=minor
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=token, val=proc_q_len
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/ProcQueueLen key=i18n_token, val=as#system.cdm.avrg_processor_q_length
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/BootAlarm]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/BootAlarm size=201
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=text, val=$check_name: Computer has been rebooted at $boot_time
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=level, val=warning
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=subsystem, val=1.1.1
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=token, val=boot_alarm
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/BootAlarm key=i18n_token, val=as#system.cdm.comp_reboot
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/InternalAlarm]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/InternalAlarm size=188
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=text, val=$check_name: $situation ($error)
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=level, val=minor
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=subsystem, val=1.1.1
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=token, val=internal_alarm
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/InternalAlarm key=i18n_token, val=as#system.cdm.situation_err
May 19 12:19:23:006 [7824] cluster: PdsToSection: section[/messages/DiskRateError]
May 19 12:19:23:006 [7824] cluster: PdsToSection - section deleted=/messages/DiskRateError size=256
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:23:006 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=level, val=major
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=token, val=disk_rate_error
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateError key=i18n_token, val=as#system.cdm.disk_rate_above_err_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/DiskRateWarning]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/DiskRateWarning size=265
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=level, val=warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=token, val=disk_rate_warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskRateWarning key=i18n_token, val=as#system.cdm.disk_rate_above_warn_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/DiskReadLatencyError]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/DiskReadLatencyError size=274
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=level, val=major
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=token, val=disk_read_latency_error
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/DiskReadLatencyWarning]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/DiskReadLatencyWarning size=283
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=level, val=warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=token, val=disk_read_latency_warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskReadLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/DiskWriteLatencyWarning]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/DiskWriteLatencyWarning size=285
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=level, val=warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=token, val=disk_write_latency_warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/DiskWriteLatencyError]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/DiskWriteLatencyError size=276
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=level, val=major
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=token, val=disk_write_latency_error
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskWriteLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/DiskLatencyWarning]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/DiskLatencyWarning size=274
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=level, val=warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=token, val=disk_latency_warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyWarning key=i18n_token, val=as#system.cdm.disk_latency_above_warn_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/DiskLatencyError]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/DiskLatencyError size=265
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=level, val=major
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=token, val=disk_latency_error
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=subsystem, val=1.1.1.1
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/DiskLatencyError key=i18n_token, val=as#system.cdm.disk_latency_above_err_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/NICRateError]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/NICRateError size=251
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=text, val=$check_name is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=level, val=major
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=token, val=nic_rate_error
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=subsystem, val=1.1.3
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateError key=i18n_token, val=as#system.cdm.nic_rate_above_err_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/NICRateWarning]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/NICRateWarning size=260
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=text, val=$check_name is now $value $unit, which is >= warning threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=level, val=warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=token, val=nic_rate_warning
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=subsystem, val=1.1.3
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/NICRateWarning key=i18n_token, val=as#system.cdm.nic_rate_above_warn_threshold
May 19 12:19:23:007 [7824] cluster: PdsToSection: section[/messages/SystemMemError]
May 19 12:19:23:007 [7824] cluster: PdsToSection - section deleted=/messages/SystemMemError size=278
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=text, val=System memory utilization is now $value $unit, which is >= error threshold ($value_limit $unit)
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=level, val=major
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=token, val=system_mem_major
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=subsystem, val=1.1.1.2
May 19 12:19:23:007 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemError key=i18n_token, val=as#system.cdm.system_memory_above_error_threshold
May 19 12:19:23:008 [7824] cluster: PdsToSection: section[/messages/SystemMemWarning]
May 19 12:19:23:008 [7824] cluster: PdsToSection - section deleted=/messages/SystemMemWarning size=286
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=text, val=System memory utilization is now $value$unit, which is >= warning threshold ($value_limit$unit)
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=level, val=warning
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=token, val=system_mem_warning
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=subsystem, val=1.1.1.2
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/SystemMemWarning key=i18n_token, val=as#system.cdm.system_memory_above_warning_threshold
May 19 12:19:23:008 [7824] cluster: PdsToSection: section[/messages/UserMemError]
May 19 12:19:23:008 [7824] cluster: PdsToSection - section deleted=/messages/UserMemError size=268
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=text, val=User memory utilization is now $value$unit, which is >= error threshold ($value_limit$unit)
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=level, val=major
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=token, val=user_mem_major
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=subsystem, val=1.1.1.2
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemError key=i18n_token, val=as#system.cdm.user_memory_above_error_threshold
May 19 12:19:23:008 [7824] cluster: PdsToSection: section[/messages/UserMemWarning]
May 19 12:19:23:008 [7824] cluster: PdsToSection - section deleted=/messages/UserMemWarning size=278
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=text, val=User memory utilization is now $value$unit, which is >= warning threshold ($value_limit$unit)
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=level, val=warning
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=token, val=user_mem_warning
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=subsystem, val=1.1.1.2
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/UserMemWarning key=i18n_token, val=as#system.cdm.user_memory_above_warning_threshold
May 19 12:19:23:008 [7824] cluster: PdsToSection: section[/messages/AvailableWarning]
May 19 12:19:23:008 [7824] cluster: PdsToSection - section deleted=/messages/AvailableWarning size=326
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=subsystem, val=1.1.1.2
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=i18n_token, val=as#system.cdm.available_memory_below_warning_threshold
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=text, val=Average ($value_number samples) available memory is now $value$unit, which is below the warning threshold ($value_limit$unit)
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=level, val=warning
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableWarning key=token, val=available_memory_warning
May 19 12:19:23:008 [7824] cluster: PdsToSection: section[/messages/AvailableError]
May 19 12:19:23:008 [7824] cluster: PdsToSection - section deleted=/messages/AvailableError size=316
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=subsystem, val=1.1.1.2
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=i18n_token, val=as#system.cdm.available_memory_below_error_threshold
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=text, val=Average ($value_number samples) available memory is now $value$unit, which is below the error threshold ($value_limit$unit)
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=level, val=major
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/AvailableError key=token, val=available_memory_error
May 19 12:19:23:008 [7824] cluster: PdsToSection: section[/messages/PhysicalError]
May 19 12:19:23:008 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalError size=286
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the error threshold ($value_limit$unit)
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=level, val=critical
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=token, val=physical_error
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalError key=i18n_token, val=as#system.cdm.avrg_phymem_above_err_threshold
May 19 12:19:23:008 [7824] cluster: PdsToSection: section[/messages/PhysicalErrorProcesses]
May 19 12:19:23:008 [7824] cluster: PdsToSection - section deleted=/messages/PhysicalErrorProcesses size=336
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=text, val=Average ($value_number samples) physical memory usage is now $value$unit, which is above the error threshold ($value_limit$unit). Top Processes $processes
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=level, val=critical
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=token, val=physical_error_processes
May 19 12:19:23:008 [7824] cluster: PdsToSection - writing to cfg.. section=/messages/PhysicalErrorProcesses key=i18n_token, val=as#system.cdm.avrg_phymem_above_err_threshold_proc
May 19 12:19:23:011 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:23:011 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:23:011 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:23:011 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:23:011 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:23:011 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:23:011 [7824] cluster: SetResourceGroupOnline - Activate profile=/cluster/FRHDGSP-APBCT50/disk
May 19 12:19:23:011 [7824] cluster: ActivateResource(): - IN
May 19 12:19:23:011 [7824] cluster: ActivateResource - probe=cdm, profile=/cluster/FRHDGSP-APBCT50/disk, file=FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:19:23:011 [7824] cluster: ActivateResource - cfgfile=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg
May 19 12:19:23:011 [7824] cluster: PdsFromFile(): file[FRHDGSP-APBCT03\cdm_iyvcqndq.pds]- IN
May 19 12:19:23:020 [7824] cluster: PdsFromFile - read 1692 bytes from FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:19:23:020 [7824] cluster: PdsFromFile(): - OUT
May 19 12:19:23:020 [7824] cluster: PdsFromFile Size=1692
May 19 12:19:23:020 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:23:020 [7824] cluster: sections        PDS_PPDS       1607 
May 19 12:19:23:020 [7824] cluster: sections[0]     PDS_PPDS         45 
May 19 12:19:23:020 [7824] cluster:  __section       PDS_PCH          30 /cluster/FRHDGSP-APBCT50/disk ~
May 19 12:19:23:020 [7824] cluster: sections[1]     PDS_PPDS         51 
May 19 12:19:23:020 [7824] cluster:  __section       PDS_PCH          36 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:020 [7824] cluster: sections[2]     PDS_PPDS         57 
May 19 12:19:23:020 [7824] cluster:  __section       PDS_PCH          42 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:020 [7824] cluster: sections[3]     PDS_PPDS        480 
May 19 12:19:23:020 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:020 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  description     PDS_PCH          16 File system I:\
May 19 12:19:23:020 [7824] cluster:  disk            PDS_PCH           6 iSCSI
May 19 12:19:23:020 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:23:020 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:23:020 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:23:020 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:23:021 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:23:021 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:23:021 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:23:021 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:23:021 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:23:021 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:23:021 [7824] cluster: ActivateResource Size=1692
May 19 12:19:23:021 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:23:021 [7824] cluster: sections        PDS_PPDS       1607 
May 19 12:19:23:021 [7824] cluster: sections[0]     PDS_PPDS         45 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          30 /cluster/FRHDGSP-APBCT50/disk ~
May 19 12:19:23:021 [7824] cluster: sections[1]     PDS_PPDS         51 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          36 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster: sections[2]     PDS_PPDS         57 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          42 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster: sections[3]     PDS_PPDS        480 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  description     PDS_PCH          16 File system I:\
May 19 12:19:23:021 [7824] cluster:  disk            PDS_PCH           6 iSCSI
May 19 12:19:23:021 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:23:021 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:23:021 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:23:021 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:23:021 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:23:022 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:23:022 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:23:022 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:23:022 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:23:022 [7824] cluster: PdsToSection(): - IN
May 19 12:19:23:022 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk size=45
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm size=51
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed size=57
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ size=480
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=active, val=no
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=description, val=File system I:\
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=disk, val=iSCSI
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=file_system_type, val=NTFS
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=percent, val=yes
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_usage, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_free, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_free_perc, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_total_size, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=inode_percent, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_inode_usage, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_inode_usage_perc, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=delta_percent, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=delta_calculate_all, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=delta_type, val=both
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_delta, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_delta_perc, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error size=122
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error key=active, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error key=threshold, val=10
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error key=message, val=DiskError
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning size=126
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning key=active, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning key=threshold, val=15
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning key=message, val=DiskWarning
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error size=128
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error key=threshold, val=10
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error key=message, val=InodeError
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning size=132
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning key=threshold, val=20
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning key=message, val=InodeWarning
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing size=109
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing key=active, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing key=message, val=DiskMissing
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error size=129
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error key=threshold, val=200
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error key=message, val=DeltaError
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning size=131
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning key=threshold, val=8
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:23:027 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:23:027 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:23:027 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:23:027 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:23:027 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:23:027 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:23:027 [7824] cluster: SetResourceGroupOnline(): - OUT
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - group=FRHDGSP-APBCT50 is Online
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - pchMsg set Free
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - CiName set to FRHDCLI-APBCT01-FRHDGSP-APBCT50
May 19 12:19:23:027 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - Successfuly open ciOpenLocalDevice
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - Sending QoS - Group=FRHDGSP-APBCT50, state=1 (Online)
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - set QoS Sample time
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - QoS Binding Done
May 19 12:19:23:027 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:027 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:027 [7824] cluster:  data   nimid=NR94975670-08729
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - QoS Sent
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - QoS un Binding Done
May 19 12:19:23:027 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56072
May 19 12:19:23:028 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:028 [7824] cluster: ciClose - [CB960E8C975369BEAE955A20080810175]
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - local Qos and ci Closed
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - pds Deleted
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Node Active set to False
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:19:23:028 [7824] cluster: ProbeInfoCheckRestart - starting
May 19 12:19:23:028 [7824] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:19:23:028 [7824] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:23:028 [7824] cluster:  data   name=cdm
May 19 12:19:23:029 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:23:029 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:029 [7824] cluster:  data   port=48013 ip=10.27.163.135
May 19 12:19:23:029 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56073
May 19 12:19:23:029 [7824] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:029 [7824] cluster: SREQUEST: _restart ->10.27.163.135/48013
May 19 12:19:23:033 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48013  h=37 d=0
May 19 12:19:23:033 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:033 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56074
May 19 12:19:23:033 [7824] cluster: SREQUEST: _close ->10.27.163.135/48013
May 19 12:19:23:033 [7824] cluster: RestartProbe - probe=cdm
May 19 12:19:23:033 [7824] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:19:23:033 [7824] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:23:033 [7824] cluster:  data   name=ntservices
May 19 12:19:23:034 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:23:034 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:034 [7824] cluster:  data   port=48012 ip=10.27.163.135
May 19 12:19:23:034 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56077
May 19 12:19:23:034 [7824] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:034 [7824] cluster: SREQUEST: _restart ->10.27.163.135/48012
May 19 12:19:23:037 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48012  h=37 d=0
May 19 12:19:23:037 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:037 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56078
May 19 12:19:23:037 [7824] cluster: SREQUEST: _close ->10.27.163.135/48012
May 19 12:19:23:037 [7824] cluster: RestartProbe - probe=ntservices
May 19 12:19:23:037 [7824] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:19:23:037 [7824] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:23:038 [7824] cluster:  data   name=sqlserver
May 19 12:19:23:038 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:23:038 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:038 [7824] cluster:  data   port=48011 ip=10.27.163.135
May 19 12:19:23:038 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56081
May 19 12:19:23:038 [7824] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:038 [7824] cluster: SREQUEST: _restart ->10.27.163.135/48011
May 19 12:19:23:041 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48011  h=37 d=0
May 19 12:19:23:041 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:041 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56082
May 19 12:19:23:041 [7824] cluster: SREQUEST: _close ->10.27.163.135/48011
May 19 12:19:23:041 [7824] cluster: RestartProbe - probe=sqlserver
May 19 12:19:23:041 [7824] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:19:23:041 [7824] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:19:23:041 [7824] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckRestart - end
May 19 12:19:23:042 [7824] cluster: MapResourceGroups(): - OUT
May 19 12:19:23:042 [7824] cluster: doWork - check my resource groups
May 19 12:19:23:042 [7824] cluster: CheckMyResourceGroups(): - IN
May 19 12:19:23:042 [7824] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:19:23:042 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:23:042 [7824] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:23:042 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:042 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:042 [7824] cluster: ciSave - saving CI   [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:042 [7824] cluster: ciSaveMetric - saving MET [MD86260C7EBA54062C2AB8DCE55957A0F] 1.18:4
May 19 12:19:23:043 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:043 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:043 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:043 [7824] cluster:  data   nimid=NR94975670-08730
May 19 12:19:23:043 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56085
May 19 12:19:23:043 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:044 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:044 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:044 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:045 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:020 [7824] cluster:  description     PDS_PCH          16 File system I:\
May 19 12:19:23:020 [7824] cluster:  disk            PDS_PCH           6 iSCSI
May 19 12:19:23:020 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:23:020 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:23:020 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:23:020 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:23:020 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:23:020 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:23:021 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:23:021 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:23:021 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:23:021 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:23:021 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:23:021 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:23:021 [7824] cluster: ActivateResource Size=1692
May 19 12:19:23:021 [7824] cluster: __file          PDS_PCH          51 C:\Program Files\Nimsoft\probe~
May 19 12:19:23:021 [7824] cluster: sections        PDS_PPDS       1607 
May 19 12:19:23:021 [7824] cluster: sections[0]     PDS_PPDS         45 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          30 /cluster/FRHDGSP-APBCT50/disk ~
May 19 12:19:23:021 [7824] cluster: sections[1]     PDS_PPDS         51 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          36 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster: sections[2]     PDS_PPDS         57 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          42 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster: sections[3]     PDS_PPDS        480 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          46 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  description     PDS_PCH          16 File system I:\
May 19 12:19:23:021 [7824] cluster:  disk            PDS_PCH           6 iSCSI
May 19 12:19:23:021 [7824] cluster:  file_system_type PDS_PCH           5 NTFS
May 19 12:19:23:021 [7824] cluster:  percent         PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  qos_disk_usage  PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_usage_perc PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  qos_disk_free   PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_free_perc PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_total_size PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  inode_percent   PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  qos_inode_usage PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_inode_usage_perc PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  delta_percent   PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  delta_calculate_all PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  delta_type      PDS_PCH           5 both
May 19 12:19:23:021 [7824] cluster:  qos_disk_delta  PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster:  qos_disk_delta_perc PDS_PCH           3 no
May 19 12:19:23:021 [7824] cluster: sections[4]     PDS_PPDS        122 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          52 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          10 DiskError
May 19 12:19:23:021 [7824] cluster: sections[5]     PDS_PPDS        126 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:021 [7824] cluster:  threshold       PDS_PCH           3 15
May 19 12:19:23:021 [7824] cluster:  message         PDS_PCH          12 DiskWarning
May 19 12:19:23:021 [7824] cluster: sections[6]     PDS_PPDS        128 
May 19 12:19:23:021 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:021 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           3 10
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          11 InodeError
May 19 12:19:23:022 [7824] cluster: sections[7]     PDS_PPDS        132 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           3 20
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          13 InodeWarning
May 19 12:19:23:022 [7824] cluster: sections[8]     PDS_PPDS        109 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          54 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           4 yes
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          12 DiskMissing
May 19 12:19:23:022 [7824] cluster: sections[9]     PDS_PPDS        129 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          58 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           4 200
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          11 DeltaError
May 19 12:19:23:022 [7824] cluster: sections[10]    PDS_PPDS        131 
May 19 12:19:23:022 [7824] cluster:  __section       PDS_PCH          60 /cluster/FRHDGSP-APBCT50/disk/~
May 19 12:19:23:022 [7824] cluster:  active          PDS_PCH           3 no
May 19 12:19:23:022 [7824] cluster:  threshold       PDS_PCH           2 8
May 19 12:19:23:022 [7824] cluster:  message         PDS_PCH          13 DeltaWarning
May 19 12:19:23:022 [7824] cluster: PdsToSection(): - IN
May 19 12:19:23:022 [7824] cluster: PdsToSection - EnterCriticalSection
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk size=45
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm size=51
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed size=57
May 19 12:19:23:023 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\]
May 19 12:19:23:023 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ size=480
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=active, val=no
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=description, val=File system I:\
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=disk, val=iSCSI
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=file_system_type, val=NTFS
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=percent, val=yes
May 19 12:19:23:023 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_usage, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_usage_perc, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_free, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_free_perc, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_total_size, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=inode_percent, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_inode_usage, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_inode_usage_perc, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=delta_percent, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=delta_calculate_all, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=delta_type, val=both
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_delta, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ key=qos_disk_delta_perc, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error size=122
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error key=active, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error key=threshold, val=10
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error key=message, val=DiskError
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning size=126
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning key=active, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning key=threshold, val=15
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning key=message, val=DiskWarning
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error size=128
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error key=threshold, val=10
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error key=message, val=InodeError
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning size=132
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning key=threshold, val=20
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning key=message, val=InodeWarning
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing size=109
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing key=active, val=yes
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing key=message, val=DiskMissing
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error size=129
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error key=threshold, val=200
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error key=message, val=DeltaError
May 19 12:19:23:024 [7824] cluster: PdsToSection: section[/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning]
May 19 12:19:23:024 [7824] cluster: PdsToSection - section deleted=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning size=131
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning key=active, val=no
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning key=threshold, val=8
May 19 12:19:23:024 [7824] cluster: PdsToSection - writing to cfg.. section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning key=message, val=DeltaWarning
May 19 12:19:23:027 [7824] cluster: PdsToSection - LeaveCriticalSection
May 19 12:19:23:027 [7824] cluster: PdsToSection(): - OUT
May 19 12:19:23:027 [7824] cluster: ProbeInfoSetRestart(): - IN
May 19 12:19:23:027 [7824] cluster: ProbeInfoSetRestart - probe[cdm].. marking restart flag
May 19 12:19:23:027 [7824] cluster: ProbeInfoSetRestart(): - OUT
May 19 12:19:23:027 [7824] cluster: ActivateResource(): - OUT
May 19 12:19:23:027 [7824] cluster: SetResourceGroupOnline(): - OUT
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - group=FRHDGSP-APBCT50 is Online
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - pchMsg set Free
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - CiName set to FRHDCLI-APBCT01-FRHDGSP-APBCT50
May 19 12:19:23:027 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - Successfuly open ciOpenLocalDevice
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - Sending QoS - Group=FRHDGSP-APBCT50, state=1 (Online)
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - set QoS Sample time
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - QoS Binding Done
May 19 12:19:23:027 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:027 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:027 [7824] cluster:  data   nimid=NR94975670-08729
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - QoS Sent
May 19 12:19:23:027 [7824] cluster: MapResourceGroups - QoS un Binding Done
May 19 12:19:23:027 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56072
May 19 12:19:23:028 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:028 [7824] cluster: ciClose - [CB960E8C975369BEAE955A20080810175]
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - local Qos and ci Closed
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - pds Deleted
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Node Active set to False
May 19 12:19:23:028 [7824] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:19:23:028 [7824] cluster: ProbeInfoCheckRestart - starting
May 19 12:19:23:028 [7824] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:19:23:028 [7824] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:23:028 [7824] cluster:  data   name=cdm
May 19 12:19:23:029 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:23:029 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:029 [7824] cluster:  data   port=48013 ip=10.27.163.135
May 19 12:19:23:029 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56073
May 19 12:19:23:029 [7824] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:029 [7824] cluster: SREQUEST: _restart ->10.27.163.135/48013
May 19 12:19:23:033 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48013  h=37 d=0
May 19 12:19:23:033 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:033 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56074
May 19 12:19:23:033 [7824] cluster: SREQUEST: _close ->10.27.163.135/48013
May 19 12:19:23:033 [7824] cluster: RestartProbe - probe=cdm
May 19 12:19:23:033 [7824] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:19:23:033 [7824] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:23:033 [7824] cluster:  data   name=ntservices
May 19 12:19:23:034 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:23:034 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:034 [7824] cluster:  data   port=48012 ip=10.27.163.135
May 19 12:19:23:034 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56077
May 19 12:19:23:034 [7824] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:034 [7824] cluster: SREQUEST: _restart ->10.27.163.135/48012
May 19 12:19:23:037 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48012  h=37 d=0
May 19 12:19:23:037 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:037 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56078
May 19 12:19:23:037 [7824] cluster: SREQUEST: _close ->10.27.163.135/48012
May 19 12:19:23:037 [7824] cluster: RestartProbe - probe=ntservices
May 19 12:19:23:037 [7824] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:19:23:037 [7824] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:23:038 [7824] cluster:  data   name=sqlserver
May 19 12:19:23:038 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:23:038 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:038 [7824] cluster:  data   port=48011 ip=10.27.163.135
May 19 12:19:23:038 [7824] cluster: sockClose:0000000000BEB040:10.27.163.135/56081
May 19 12:19:23:038 [7824] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:038 [7824] cluster: SREQUEST: _restart ->10.27.163.135/48011
May 19 12:19:23:041 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48011  h=37 d=0
May 19 12:19:23:041 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:041 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56082
May 19 12:19:23:041 [7824] cluster: SREQUEST: _close ->10.27.163.135/48011
May 19 12:19:23:041 [7824] cluster: RestartProbe - probe=sqlserver
May 19 12:19:23:041 [7824] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:19:23:041 [7824] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:19:23:041 [7824] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckRestart - end
May 19 12:19:23:042 [7824] cluster: MapResourceGroups(): - OUT
May 19 12:19:23:042 [7824] cluster: doWork - check my resource groups
May 19 12:19:23:042 [7824] cluster: CheckMyResourceGroups(): - IN
May 19 12:19:23:042 [7824] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:19:23:042 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:23:042 [7824] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:23:042 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:042 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:042 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:042 [7824] cluster: ciSave - saving CI   [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:042 [7824] cluster: ciSaveMetric - saving MET [MD86260C7EBA54062C2AB8DCE55957A0F] 1.18:4
May 19 12:19:23:043 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:043 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:043 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:043 [7824] cluster:  data   nimid=NR94975670-08730
May 19 12:19:23:043 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56085
May 19 12:19:23:043 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:044 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:044 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:044 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:044 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:045 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:045 [7824] cluster: PdsFromSection - section=/messages size=25
May 19 12:19:23:045 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:045 [7824] cluster: PdsFromSection - section=/messages/CpuError size=264
May 19 12:19:23:045 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:045 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuWarning size=271
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuErrorProcesses size=331
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuWarningProcesses size=335
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuError-Ind size=263
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuWarning-Ind size=270
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuUserError size=270
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuUserWarning size=277
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuUserError-Ind size=269
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuUserWarning-Ind size=276
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuSystemError size=276
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuSystemWarning size=283
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuSystemError-Ind size=275
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuSystemWarning-Ind size=289
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitError size=278
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning size=285
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitError-Ind size=277
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIdleError size=270
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIdleWarning size=277
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIdleError-Ind size=269
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuIdleWarning-Ind size=276
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:046 [7824] cluster: PdsFromSection - section=/messages/CpuMultiMaxError size=223
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:046 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/CpuMultiDiffError size=308
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/PagefileError size=295
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/PagefileWarning size=299
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/PagingError size=264
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/PagingWarning size=271
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/PhysicalWarning size=290
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/PhysicalWarningProcesses size=342
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/SwapError size=272
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/SwapWarning size=279
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/DiskError size=322
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/DiskWarning size=326
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/InodeError size=282
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/InodeWarning size=289
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/DeltaError size=210
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/DeltaWarning size=214
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/DiskMissing size=191
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/DiskMounted size=185
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/ConnectionError size=186
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/ProcQueueLen size=275
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:047 [7824] cluster: PdsFromSection - section=/messages/BootAlarm size=201
May 19 12:19:23:047 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/InternalAlarm size=188
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskRateError size=256
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskRateWarning size=265
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskReadLatencyError size=274
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskReadLatencyWarning size=283
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskWriteLatencyWarning size=285
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskWriteLatencyError size=276
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskLatencyWarning size=274
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/DiskLatencyError size=265
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/NICRateError size=251
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/NICRateWarning size=260
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/SystemMemError size=278
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/SystemMemWarning size=286
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/UserMemError size=268
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/UserMemWarning size=278
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/AvailableWarning size=326
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/AvailableError size=316
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/PhysicalError size=286
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:048 [7824] cluster: PdsFromSection - section=/messages/PhysicalErrorProcesses size=336
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:048 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:049 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:049 [7824] cluster: PdsMD5Sum - MD5=c6e9bbecf1e1ebfadd6fbbb1649f880f size=17669
May 19 12:19:23:049 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/messages md5=c6e9bbecf1e1ebfadd6fbbb1649f880f
May 19 12:19:23:049 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:049 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:049 [7824] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:19:23:049 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:19:23:049 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:049 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:049 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:049 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:049 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:049 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:049 [7824] cluster:  data   nimid=NR94975670-08731
May 19 12:19:23:049 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56086
May 19 12:19:23:050 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:050 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:050 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:050 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:19:23:050 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:050 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:050 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:050 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:051 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk size=45
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:051 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm size=51
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:051 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed size=57
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:051 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ size=480
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:051 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error size=122
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:051 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning size=126
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:051 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error size=128
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:051 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:052 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning size=132
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:052 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing size=109
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:052 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error size=129
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:052 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning size=131
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:052 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:052 [7824] cluster: PdsMD5Sum - MD5=724d51f8f325b7b153386bf28a354f38 size=1692
May 19 12:19:23:052 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/cluster/FRHDGSP-APBCT50/disk md5=724d51f8f325b7b153386bf28a354f38
May 19 12:19:23:052 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:052 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:052 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:23:052 [7824] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:19:23:052 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:23:052 [7824] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:23:052 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:19:23:052 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:052 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:052 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:052 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:052 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:052 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:052 [7824] cluster:  data   nimid=NR94975670-08732
May 19 12:19:23:052 [7824] cluster: sockClose:0000000000B41860:10.27.163.135/56088
May 19 12:19:23:053 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:053 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:053 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:053 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:19:23:053 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:053 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:053 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:053 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:054 [7824] cluster: PdsFromSection - section=/messages size=25
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:054 [7824] cluster: PdsFromSection - section=/messages/CpuError size=264
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:054 [7824] cluster: PdsFromSection - section=/messages/CpuWarning size=271
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:054 [7824] cluster: PdsFromSection - section=/messages/CpuErrorProcesses size=331
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:054 [7824] cluster: PdsFromSection - section=/messages/CpuWarningProcesses size=335
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:054 [7824] cluster: PdsFromSection - section=/messages/CpuError-Ind size=263
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:054 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:054 [7824] cluster: PdsFromSection - section=/messages/CpuWarning-Ind size=270
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuUserError size=270
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuUserWarning size=277
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuUserError-Ind size=269
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuUserWarning-Ind size=276
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuSystemError size=276
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuSystemWarning size=283
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuSystemError-Ind size=275
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuSystemWarning-Ind size=289
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitError size=278
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning size=285
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitError-Ind size=277
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIdleError size=270
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIdleWarning size=277
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIdleError-Ind size=269
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuIdleWarning-Ind size=276
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuMultiMaxError size=223
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/CpuMultiDiffError size=308
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/PagefileError size=295
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/PagefileWarning size=299
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:055 [7824] cluster: PdsFromSection - section=/messages/PagingError size=264
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:055 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/PagingWarning size=271
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/PhysicalWarning size=290
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/PhysicalWarningProcesses size=342
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/SwapError size=272
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/SwapWarning size=279
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskError size=322
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskWarning size=326
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/InodeError size=282
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/InodeWarning size=289
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DeltaError size=210
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DeltaWarning size=214
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskMissing size=191
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskMounted size=185
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/ConnectionError size=186
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/ProcQueueLen size=275
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/BootAlarm size=201
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/InternalAlarm size=188
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskRateError size=256
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskRateWarning size=265
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskReadLatencyError size=274
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskReadLatencyWarning size=283
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:056 [7824] cluster: PdsFromSection - section=/messages/DiskWriteLatencyWarning size=285
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:056 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/DiskWriteLatencyError size=276
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/DiskLatencyWarning size=274
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/DiskLatencyError size=265
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/NICRateError size=251
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/NICRateWarning size=260
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/SystemMemError size=278
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/SystemMemWarning size=286
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/UserMemError size=268
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/UserMemWarning size=278
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/AvailableWarning size=326
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/AvailableError size=316
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/PhysicalError size=286
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:057 [7824] cluster: PdsFromSection - section=/messages/PhysicalErrorProcesses size=336
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:057 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:057 [7824] cluster: PdsMD5Sum - MD5=c6e9bbecf1e1ebfadd6fbbb1649f880f size=17669
May 19 12:19:23:057 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/messages md5=c6e9bbecf1e1ebfadd6fbbb1649f880f
May 19 12:19:23:057 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:057 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:057 [7824] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:19:23:057 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:19:23:057 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:057 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:057 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:058 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:058 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:058 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:058 [7824] cluster:  data   nimid=NR94975670-08733
May 19 12:19:23:058 [7824] cluster: sockClose:0000000000B46670:10.27.163.135/56092
May 19 12:19:23:058 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:058 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:058 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:058 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:19:23:058 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:058 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:058 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:058 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:059 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:059 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk size=45
May 19 12:19:23:059 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:059 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm size=51
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed size=57
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ size=483
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/error size=122
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/warning size=126
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_error size=128
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_warning size=132
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/missing size=109
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_error size=129
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:060 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_warning size=131
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:060 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:060 [7824] cluster: PdsMD5Sum - MD5=71cc6d1723640b6ee3340d617c298977 size=1695
May 19 12:19:23:060 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/cluster/FRHDGSP-APBCT40/disk md5=71cc6d1723640b6ee3340d617c298977
May 19 12:19:23:060 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:060 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:060 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:23:060 [7824] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:19:23:060 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:23:060 [7824] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:23:060 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:060 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:060 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:060 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:060 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:061 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:061 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:061 [7824] cluster:  data   nimid=NR94975670-08735
May 19 12:19:23:061 [7824] cluster: sockClose:0000000000B46670:10.27.163.135/56095
May 19 12:19:23:061 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:061 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:061 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:061 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:19:23:061 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:061 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:061 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:061 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:062 [7824] cluster: PdsFromSection - section=/messages size=25
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:062 [7824] cluster: PdsFromSection - section=/messages/CpuError size=264
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:062 [7824] cluster: PdsFromSection - section=/messages/CpuWarning size=271
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:062 [7824] cluster: PdsFromSection - section=/messages/CpuErrorProcesses size=331
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:062 [7824] cluster: PdsFromSection - section=/messages/CpuWarningProcesses size=335
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:062 [7824] cluster: PdsFromSection - section=/messages/CpuError-Ind size=263
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:062 [7824] cluster: PdsFromSection - section=/messages/CpuWarning-Ind size=270
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:062 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuUserError size=270
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuUserWarning size=277
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuUserError-Ind size=269
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuUserWarning-Ind size=276
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuSystemError size=276
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuSystemWarning size=283
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuSystemError-Ind size=275
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuSystemWarning-Ind size=289
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitError size=278
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning size=285
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitError-Ind size=277
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIdleError size=270
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIdleWarning size=277
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIdleError-Ind size=269
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuIdleWarning-Ind size=276
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuMultiMaxError size=223
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/CpuMultiDiffError size=308
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/PagefileError size=295
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/PagefileWarning size=299
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/PagingError size=264
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/PagingWarning size=271
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/PhysicalWarning size=290
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/PhysicalWarningProcesses size=342
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/SwapError size=272
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:063 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:063 [7824] cluster: PdsFromSection - section=/messages/SwapWarning size=279
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskError size=322
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskWarning size=326
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/InodeError size=282
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/InodeWarning size=289
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DeltaError size=210
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DeltaWarning size=214
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskMissing size=191
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskMounted size=185
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/ConnectionError size=186
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/ProcQueueLen size=275
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/BootAlarm size=201
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/InternalAlarm size=188
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskRateError size=256
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskRateWarning size=265
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskReadLatencyError size=274
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskReadLatencyWarning size=283
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskWriteLatencyWarning size=285
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskWriteLatencyError size=276
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskLatencyWarning size=274
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/DiskLatencyError size=265
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/NICRateError size=251
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/NICRateWarning size=260
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/SystemMemError size=278
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:064 [7824] cluster: PdsFromSection - section=/messages/SystemMemWarning size=286
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:064 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:065 [7824] cluster: PdsFromSection - section=/messages/UserMemError size=268
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:065 [7824] cluster: PdsFromSection - section=/messages/UserMemWarning size=278
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:065 [7824] cluster: PdsFromSection - section=/messages/AvailableWarning size=326
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:065 [7824] cluster: PdsFromSection - section=/messages/AvailableError size=316
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:065 [7824] cluster: PdsFromSection - section=/messages/PhysicalError size=286
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:065 [7824] cluster: PdsFromSection - section=/messages/PhysicalErrorProcesses size=336
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:065 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:065 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:065 [7824] cluster: PdsMD5Sum - MD5=c6e9bbecf1e1ebfadd6fbbb1649f880f size=17669
May 19 12:19:23:065 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/messages md5=c6e9bbecf1e1ebfadd6fbbb1649f880f
May 19 12:19:23:065 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:065 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:065 [7824] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:19:23:065 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:065 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:065 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:065 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:065 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:065 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:065 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:065 [7824] cluster:  data   nimid=NR94975670-08736
May 19 12:19:23:065 [7824] cluster: sockClose:0000000000B43880:10.27.163.135/56098
May 19 12:19:23:066 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:066 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:066 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:066 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:19:23:066 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:066 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:066 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:066 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:067 [8520] cluster: main - adding Sleep 10
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [8520] cluster: RREQUEST: discover_cluster <-10.27.163.135/56100  h=362 d=0
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk size=45
May 19 12:19:23:067 [8520] cluster: nimSockaddr2Ip - found 10.27.163.135
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm size=51
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed size=57
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ size=484
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/error size=122
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning size=126
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error size=128
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning size=132
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/missing size=109
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_error size=129
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:067 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:067 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_warning size=131
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ size=487
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/error size=122
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/warning size=126
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_error size=128
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_warning size=132
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/missing size=109
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_error size=129
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_warning size=131
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ size=485
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/error size=122
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/warning size=126
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_error size=128
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_warning size=132
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/missing size=109
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_error size=129
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:068 [7824] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_warning size=131
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:068 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:068 [7824] cluster: PdsMD5Sum - MD5=838c44e54cb6c0807f04815c8cb48393 size=4582
May 19 12:19:23:068 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/cluster/FRHDGSP-APBCT03/disk md5=838c44e54cb6c0807f04815c8cb48393
May 19 12:19:23:068 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:068 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:068 [7824] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:19:23:068 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:068 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:068 [7824] cluster: ProbeInfoCheckResource - probe 'sqlserver' is running on this Robot
May 19 12:19:23:068 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:068 [7824] cluster: ciSave - saving CI   [CE6277C84DAB7AD1C8E1C7F83CE1606EF]
May 19 12:19:23:069 [7824] cluster: ciSaveMetric - saving MET [M8B59059DE99FC1EB22F4606052DE3081] 1.18:4
May 19 12:19:23:069 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:070 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:070 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:070 [7824] cluster:  data   nimid=NR94975670-08737
May 19 12:19:23:070 [7824] cluster: sockClose:00000000010572E0:10.27.163.135/56103
May 19 12:19:23:070 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:070 [7824] cluster: ciClose - [CE6277C84DAB7AD1C8E1C7F83CE1606EF]
May 19 12:19:23:070 [7824] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:23:070 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:19:23:070 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:070 [8520] cluster:  data   time=1589883563 access=1 ident=30545
May 19 12:19:23:070 [8520] cluster: sockClose:000000000103C430:10.27.163.135/56101
May 19 12:19:23:070 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:19:23:070 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:070 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:23:070 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:070 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:070 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:070 [8520] cluster: cmd_discover_cluster(): - IN
May 19 12:19:23:070 [8520] cluster:  (cmd_discover_cluster) Waiting for gPluginCallbackLock 
May 19 12:19:23:070 [8520] cluster:  (cmd_discover_cluster) Locking gPluginCallbackLock 
May 19 12:19:23:070 [8520] cluster: discover_cluster - from 10.27.163.135/56100
May 19 12:19:23:070 [8520] cluster:  (cmd_discover_cluster)Locking gcsPlugin 
May 19 12:19:23:074 [8520] cluster:  (cmd_discover_cluster) Releasing gcsPlugin 
May 19 12:19:23:074 [8520] cluster: discover_cluster - node name is FRHDCLI-APBCT01
May 19 12:19:23:077 [8520] cluster: (cmd_discover_cluster) - IP address:10.27.163.142. Cluster name is FRHDGSP-APBCT03.
May 19 12:19:23:077 [8520] cluster: SREPLY: status = 0(OK) ->10.27.163.135/56100
May 19 12:19:23:077 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:077 [8520] cluster:  data   ip=10.27.163.142
May 19 12:19:23:077 [8520] cluster:  (cmd_discover_cluster) Releasing gPluginCallbackLock 
May 19 12:19:23:077 [8520] cluster: cmd_discover_cluster(): - OUT
May 19 12:19:23:077 [8520] cluster: RREQUEST: get_cluster_resources <-10.27.163.135/56100  h=367 d=0
May 19 12:19:23:077 [8520] cluster: get_cluster_resources - from 10.27.163.135/56100 [0xb43880]
May 19 12:19:23:077 [18372] cluster:  (thrGetResources) Waiting gPluginCallbackLock 
May 19 12:19:23:077 [18372] cluster:  (thrGetResources) Locking gPluginCallbackLock 
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:080 [7824] cluster: PdsFromSection - section=/connections size=28
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:080 [7824] cluster: PdsFromSection - section=/connections/frhdgsp-apbct30\APBCT100PPI size=376
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:080 [7824] cluster: PdsFromSection - section=/connections/sample_conn size=221
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:080 [7824] cluster: PdsFromSection - section=/connections/w2smssql size=207
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:080 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:081 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:081 [7824] cluster: PdsMD5Sum - MD5=cdba6b2f687b56681e29a4366696ffb2 size=974
May 19 12:19:23:081 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/database/sqlserver\sqlserver_monitor.cfg section=/connections md5=cdba6b2f687b56681e29a4366696ffb2
May 19 12:19:23:081 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:081 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:081 [7824] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:19:23:081 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:081 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:081 [7824] cluster: ProbeInfoCheckResource - probe 'sqlserver' is running on this Robot
May 19 12:19:23:081 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:082 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:082 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:082 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:082 [7824] cluster:  data   nimid=NR94975670-08738
May 19 12:19:23:082 [7824] cluster: sockClose:00000000010572E0:10.27.163.135/56104
May 19 12:19:23:082 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:082 [7824] cluster: ciClose - [CE6277C84DAB7AD1C8E1C7F83CE1606EF]
May 19 12:19:23:082 [7824] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:23:082 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:19:23:082 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:082 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:23:082 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:082 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:092 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:093 [7824] cluster: PdsFromSection - section=/profiles/frhdgsp-apbct30\APBCT100PPI size=502
May 19 12:19:23:093 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:094 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:094 [7824] cluster: PdsMD5Sum - MD5=464905643abf88ce0c95bdb859b77d53 size=618
May 19 12:19:23:094 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/database/sqlserver\sqlserver_monitor.cfg section=/profiles/frhdgsp-apbct30\APBCT100PPI md5=464905643abf88ce0c95bdb859b77d53
May 19 12:19:23:094 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:094 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:094 [7824] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:19:23:094 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:094 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:094 [7824] cluster: ProbeInfoCheckResource - probe 'ntservices' is running on this Robot
May 19 12:19:23:094 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:094 [7824] cluster: ciSave - saving CI   [CF5BD7FD14AFF394D12AF50E678791EA0]
May 19 12:19:23:094 [7824] cluster: ciSaveMetric - saving MET [M656F0FC83C4AD053253D554EC1E6D131] 1.18:4
May 19 12:19:23:095 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:095 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:095 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:095 [7824] cluster:  data   nimid=NR94975670-08739
May 19 12:19:23:095 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56105
May 19 12:19:23:095 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:095 [7824] cluster: ciClose - [CF5BD7FD14AFF394D12AF50E678791EA0]
May 19 12:19:23:095 [7824] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:23:096 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:19:23:096 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:096 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:23:096 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:096 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:097 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:097 [7824] cluster: PdsFromSection - section=/services/SQLAgent$APBCT100PPI size=544
May 19 12:19:23:097 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:097 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:097 [7824] cluster: PdsMD5Sum - MD5=7440c065c91c79ca0dd17d59c1e6e5c8 size=652
May 19 12:19:23:097 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/ntservices\ntservices.cfg section=/services/SQLAgent$APBCT100PPI md5=7440c065c91c79ca0dd17d59c1e6e5c8
May 19 12:19:23:097 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:097 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:097 [7824] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:19:23:097 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:097 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:097 [7824] cluster: ProbeInfoCheckResource - probe 'ntservices' is running on this Robot
May 19 12:19:23:097 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:097 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:097 [18372] cluster:  (thrGetResources) Releasing gPluginCallbackLock 
May 19 12:19:23:097 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:097 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:097 [7824] cluster:  data   nimid=NR94975670-08740
May 19 12:19:23:097 [7824] cluster: sockClose:0000000001035060:10.27.163.135/56106
May 19 12:19:23:098 [18372] cluster: SREPLY: status = 0(OK) ->10.27.163.135/56100
May 19 12:19:23:098 [18372] cluster:  head   mtype=200 status=0 seq=1
May 19 12:19:23:098 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:098 [18372] cluster:  data   resources=PPDS(4576)
May 19 12:19:23:098 [18372] cluster: sockClose:0000000000B43880:10.27.163.135/48008
May 19 12:19:23:098 [7824] cluster: ciClose - [CF5BD7FD14AFF394D12AF50E678791EA0]
May 19 12:19:23:098 [18372] cluster: SREQUEST: _close ->10.27.163.135/56100
May 19 12:19:23:098 [7824] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:23:098 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:19:23:098 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:098 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:23:098 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:098 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:099 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:099 [7824] cluster: PdsFromSection - section=/services/MSSQL$APBCT100PPI size=529
May 19 12:19:23:099 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:099 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:099 [7824] cluster: PdsMD5Sum - MD5=523ad9943284d3f992e27fc45cc469ac size=637
May 19 12:19:23:099 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/ntservices\ntservices.cfg section=/services/MSSQL$APBCT100PPI md5=523ad9943284d3f992e27fc45cc469ac
May 19 12:19:23:100 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:100 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:100 [7824] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:19:23:100 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:100 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:100 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:100 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:100 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:100 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:100 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:100 [7824] cluster:  data   nimid=NR94975670-08741
May 19 12:19:23:100 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56107
May 19 12:19:23:100 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:100 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:100 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:100 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:19:23:100 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:101 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:101 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:101 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\ size=476
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/error size=98
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/warning size=102
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/inode_error size=104
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/inode_warning size=108
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/missing size=85
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/delta_error size=105
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:102 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/delta_warning size=107
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:102 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:102 [7824] cluster: PdsMD5Sum - MD5=b9af1164c9c9a5d532f8b4fe8b80583a size=1340
May 19 12:19:23:102 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/disk/alarm/fixed/F:\ md5=b9af1164c9c9a5d532f8b4fe8b80583a
May 19 12:19:23:102 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:102 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:102 [7824] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:19:23:102 [7824] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:23:102 [7824] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:23:102 [7824] cluster: ProbeInfoCheckResource - probe 'cdm' is running on this Robot
May 19 12:19:23:102 [7824] cluster: ciOpen - cache path: C:\Program Files\Nimsoft\niscache
May 19 12:19:23:102 [7824] cluster: ciPostMessage - alarm
May 19 12:19:23:103 [7824] cluster: RREPLY: status=OK(0) <-10.27.163.135/48001  h=37 d=28
May 19 12:19:23:103 [7824] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:103 [7824] cluster:  data   nimid=NR94975670-08742
May 19 12:19:23:103 [7824] cluster: sockClose:00000000010304D0:10.27.163.135/56108
May 19 12:19:23:103 [7824] cluster: SREQUEST: _close ->10.27.163.135/48001
May 19 12:19:23:103 [7824] cluster: ciClose - [CED2F6B51A258CD9201CD191643752C28]
May 19 12:19:23:103 [7824] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:23:103 [7824] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:19:23:103 [7824] cluster: ProbeInfoCheckResource - r->mtime Thu Jan 01 01:00:00 1970
 
May 19 12:19:23:103 [7824] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:23:103 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:103 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\ size=476
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/error size=98
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/warning size=102
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/inode_error size=104
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/inode_warning size=108
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/missing size=85
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/delta_error size=105
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:104 [7824] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/delta_warning size=107
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:104 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:105 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:105 [7824] cluster: PdsMD5Sum - MD5=6f30f24f08a9ed1eb14fcec1163f76b2 size=1340
May 19 12:19:23:105 [7824] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/disk/alarm/fixed/E:\ md5=6f30f24f08a9ed1eb14fcec1163f76b2
May 19 12:19:23:105 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:105 [7824] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:23:105 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:23:105 [7824] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:19:23:105 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:23:105 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:23:105 [7824] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:19:23:105 [7824] cluster: CheckResourceGroup(): - IN
May 19 12:19:23:105 [7824] cluster: CheckResourceGroup(): - OUT
May 19 12:19:23:105 [7824] cluster: CheckConfigVersionPds(): - IN
May 19 12:19:23:105 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:105 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:105 [8520] cluster: RREQUEST: register_section <-10.27.163.135/56109  h=362 d=154
May 19 12:19:23:105 [8520] cluster:  data   profile=/cluster/FRHDGSP-APBCT03/disk
May 19 12:19:23:105 [8520] cluster: nimSockaddr2Ip - found 10.27.163.135
May 19 12:19:23:105 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:105 [7824] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:19:23:105 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:105 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:105 [7824] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:19:23:105 [7824] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:19:23:105 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:105 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:105 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:105 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:106 [7824] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:19:23:106 [7824] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:19:23:106 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:106 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:106 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:106 [7824] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:19:23:106 [7824] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:19:23:106 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:106 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:106 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:107 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:107 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:107 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:107 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:107 [7824] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:19:23:107 [7824] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:19:23:107 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:107 [7824] cluster: PdsSectionMD5(): - IN
May 19 12:19:23:107 [7824] cluster: PdsFromSection(): - IN
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:107 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:107 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:19:23:107 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:108 [7824] cluster: recursive_section2pds(): - IN
May 19 12:19:23:108 [7824] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:19:23:108 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:108 [7824] cluster: recursive_section2pds(): - OUT
May 19 12:19:23:108 [7824] cluster: PdsFromSection(): - OUT
May 19 12:19:23:108 [7824] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:19:23:108 [7824] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:19:23:108 [7824] cluster: PdsSectionMD5(): - OUT
May 19 12:19:23:108 [7824] cluster: CheckConfigVersionPds(): - OUT
May 19 12:19:23:108 [7824] cluster: CheckMyResourceGroups(): - OUT
May 19 12:19:23:108 [7824] cluster: node_state_resgroup_thread(): - OUT
May 19 12:19:23:108 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:19:23:108 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:23:108 [8520] cluster:  data   time=1589883563 access=2 ident=30545
May 19 12:19:23:108 [8520] cluster: sockClose:0000000000B45660:10.27.163.135/56110
May 19 12:19:23:108 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:23:109 [8520] cluster: register_section - from 10.27.163.135/56109
May 19 12:19:23:109 [8520] cluster: cmd_register_section(): - IN
May 19 12:19:23:109 [8520] cluster:  (cmd_register_section) Waiting gRestartCallbackLock 
May 19 12:19:23:411 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:24:411 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:25:412 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:26:413 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:27:414 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:28:415 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:29:416 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:30:417 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:31:417 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:32:418 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:33:419 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:34:420 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:35:421 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:36:422 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:37:422 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:38:423 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:38:700 [12644] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:19:38:700 [12644] cluster: (updateNodeConf) - Connect to ip/host: 10.30.10.16
May 19 12:19:38:700 [12644] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:19:38:700 [12644] cluster: updateNodeConf(): - OUT
May 19 12:19:38:700 [12644] cluster: child udp - Update group configs
May 19 12:19:38:700 [12644] cluster: updateGroupConf(): - IN
May 19 12:19:38:700 [12644] cluster: (updateGroupConf) - This node ip/host: 10.27.163.135
May 19 12:19:38:700 [12644] cluster: ResourceGroupConfigurationRequest(): - IN
May 19 12:19:38:700 [12644] cluster: ResourceGroupConfigurationRequest(): - OUT
May 19 12:19:38:700 [12644] cluster: (updateGroupConf) - Connect to ip/host: 10.30.10.16, port: 48003
May 19 12:19:39:424 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:40:425 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:41:426 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:42:427 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:43:427 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:44:428 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:45:429 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:46:430 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:47:431 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:48:432 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:49:433 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:50:433 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:51:434 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:52:435 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:53:436 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:54:437 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:55:438 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:56:438 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:57:439 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:58:440 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:59:441 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:19:59:708 [12644] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:19:59:708 [12644] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:19:59:708 [12644] cluster: (updateGroupConf) - Finished!
May 19 12:19:59:708 [12644] cluster: updateGroupConf(): - OUT
May 19 12:19:59:708 [12644] cluster:  (update_node_group_conf_thread) Releasing gRestartCallbackLock 
May 19 12:19:59:708 [8520] cluster:  (cmd_register_section) Locking gRestartCallbackLock 
May 19 12:19:59:708 [8520] cluster: SREQUEST: nametoip ->10.27.163.135/48000
May 19 12:19:59:708 [8520] cluster:  data   name=controller
May 19 12:19:59:709 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=37
May 19 12:19:59:709 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:709 [8520] cluster:  data   port=48000 ip=10.27.163.135
May 19 12:19:59:709 [8520] cluster: sockClose:0000000000B45660:10.27.163.135/56128
May 19 12:19:59:709 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:59:709 [8520] cluster: SREQUEST: probe_list ->10.27.163.135/48000
May 19 12:19:59:709 [8520] cluster:  data   name=cdm robot=
May 19 12:19:59:713 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=537
May 19 12:19:59:713 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:713 [8520] cluster:  data   cdm=PDS(526)
May 19 12:19:59:713 [8520] cluster: (cmd_register_section) - OK - Probe 'cdm' found on local robot
May 19 12:19:59:713 [8520] cluster: sockClose:000000000102F010:10.27.163.135/56129
May 19 12:19:59:713 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:59:713 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT50
May 19 12:19:59:713 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT40
May 19 12:19:59:713 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT03
May 19 12:19:59:713 [8520] cluster: (cmd_register_section) - Profile: /cluster/FRHDGSP-APBCT03/disk, Probe: cdm, Resource Group: FRHDGSP-APBCT03. Already registered
May 19 12:19:59:713 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: Cluster Group
May 19 12:19:59:713 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: Available Storage
May 19 12:19:59:713 [8520] cluster:  (cmd_register_section) Releasing gRestartCallbackLock 
May 19 12:19:59:713 [8520] cluster: SREPLY: status = 1(error) ->10.27.163.135/56109
May 19 12:19:59:713 [8520] cluster:  head   mtype=200 status=1 seq=0
May 19 12:19:59:713 [8520] cluster: cmd_register_section(): - OUT
May 19 12:19:59:713 [8520] cluster: (Main)update node & group conf is starting in thread 8404
May 19 12:19:59:713 [8520] cluster: main - adding Sleep 10
May 19 12:19:59:713 [8520] cluster: RREQUEST: set_node_up <-10.27.163.134/56536  h=293 d=106
May 19 12:19:59:713 [8404] cluster: doWork(): - IN
May 19 12:19:59:713 [8520] cluster: nimSockaddr2Ip - found 10.27.163.134
May 19 12:19:59:713 [8404] cluster: doWork - check groups
May 19 12:19:59:713 [8404] cluster: MapResourceGroups(): - IN
May 19 12:19:59:713 [8404] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:19:59:714 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:19:59:716 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:19:59:716 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:716 [8520] cluster:  data   time=1589883599 access=2 ident=30663
May 19 12:19:59:716 [8520] cluster: sockClose:0000000000B45660:10.27.163.135/56131
May 19 12:19:59:716 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:59:717 [8520] cluster: cmd_set_node_up(): - IN
May 19 12:19:59:717 [8520] cluster: set_node_up - from 10.27.163.134/56536 [0x102f010]
May 19 12:19:59:717 [8520] cluster: cmd_set_node_up(): - OUT
May 19 12:19:59:717 [17068] cluster: thrSetNodeUp(): - IN
May 19 12:19:59:717 [8520] cluster: RREQUEST: register_section <-10.27.163.135/56134  h=362 d=154
May 19 12:19:59:717 [17068] cluster:  (thrSetNodeUp) Waiting gthreadCallbackLock 
May 19 12:19:59:717 [8520] cluster:  data   profile=/cluster/FRHDGSP-APBCT40/disk
May 19 12:19:59:717 [17068] cluster:  (thrSetNodeUp) Locking gthreadCallbackLock 
May 19 12:19:59:717 [8520] cluster: nimSockaddr2Ip - found 10.27.163.135
May 19 12:19:59:717 [17068] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:19:59:717 [17068] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:59:717 [17068] cluster: FindNode() End - OUT
May 19 12:19:59:717 [17068] cluster: thrSetNodeUp - Caller address: /TotalDxim/SDCPPDXIM07/frhdstd-apbct01/cluster, My adress: 10.27.163.135
May 19 12:19:59:717 [17068] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56536
May 19 12:19:59:717 [17068] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:717 [17068] cluster: sockClose:000000000102F010:10.27.163.135/48008
May 19 12:19:59:717 [17068] cluster: SREQUEST: _close ->10.27.163.134/56536
May 19 12:19:59:717 [17068] cluster:  (thrSetNodeUp) Releasing gthreadCallbackLock 
May 19 12:19:59:717 [17068] cluster: thrSetNodeUp(): - OUT
May 19 12:19:59:717 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:19:59:720 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:19:59:720 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:720 [8520] cluster:  data   time=1589883599 access=2 ident=30663
May 19 12:19:59:720 [8520] cluster: sockClose:0000000000B7E8A0:10.27.163.135/56135
May 19 12:19:59:720 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:59:720 [8520] cluster: register_section - from 10.27.163.135/56134
May 19 12:19:59:720 [8520] cluster: cmd_register_section(): - IN
May 19 12:19:59:720 [8520] cluster:  (cmd_register_section) Waiting gRestartCallbackLock 
May 19 12:19:59:720 [8520] cluster:  (cmd_register_section) Locking gRestartCallbackLock 
May 19 12:19:59:720 [8520] cluster: SREQUEST: probe_list ->10.27.163.135/48000
May 19 12:19:59:720 [8520] cluster:  data   name=cdm robot=
May 19 12:19:59:723 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=537
May 19 12:19:59:723 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:723 [8520] cluster:  data   cdm=PDS(526)
May 19 12:19:59:723 [8520] cluster: (cmd_register_section) - OK - Probe 'cdm' found on local robot
May 19 12:19:59:723 [8520] cluster: sockClose:000000000102F010:10.27.163.135/56137
May 19 12:19:59:723 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:59:723 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT50
May 19 12:19:59:723 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT40
May 19 12:19:59:723 [8520] cluster: (cmd_register_section) - Profile: /cluster/FRHDGSP-APBCT40/disk, Probe: cdm, Resource Group: FRHDGSP-APBCT40. Already registered
May 19 12:19:59:723 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT03
May 19 12:19:59:723 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: Cluster Group
May 19 12:19:59:724 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: Available Storage
May 19 12:19:59:724 [8520] cluster:  (cmd_register_section) Releasing gRestartCallbackLock 
May 19 12:19:59:724 [8520] cluster: SREPLY: status = 1(error) ->10.27.163.135/56134
May 19 12:19:59:724 [8520] cluster:  head   mtype=200 status=1 seq=0
May 19 12:19:59:724 [8520] cluster: cmd_register_section(): - OUT
May 19 12:19:59:724 [8520] cluster: RREQUEST: _close <-10.27.163.135/56109  h=351 d=0
May 19 12:19:59:724 [8520] cluster: sockClose:0000000000B43880:10.27.163.135/48008
May 19 12:19:59:724 [8520] cluster: RREQUEST: _close <-10.27.163.135/56134  h=351 d=0
May 19 12:19:59:724 [8520] cluster: sockClose:0000000000B45660:10.27.163.135/48008
May 19 12:19:59:726 [8520] cluster: RREQUEST: register_section <-10.27.163.135/56139  h=362 d=154
May 19 12:19:59:726 [8520] cluster:  data   profile=/cluster/FRHDGSP-APBCT50/disk
May 19 12:19:59:726 [8520] cluster: nimSockaddr2Ip - found 10.27.163.135
May 19 12:19:59:726 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:19:59:729 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:19:59:729 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:729 [8520] cluster:  data   time=1589883599 access=2 ident=30663
May 19 12:19:59:729 [8520] cluster: sockClose:0000000000B43880:10.27.163.135/56140
May 19 12:19:59:729 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:59:729 [8520] cluster: register_section - from 10.27.163.135/56139
May 19 12:19:59:729 [8520] cluster: cmd_register_section(): - IN
May 19 12:19:59:729 [8520] cluster:  (cmd_register_section) Waiting gRestartCallbackLock 
May 19 12:19:59:729 [8520] cluster:  (cmd_register_section) Locking gRestartCallbackLock 
May 19 12:19:59:730 [8520] cluster: SREQUEST: probe_list ->10.27.163.135/48000
May 19 12:19:59:730 [8520] cluster:  data   name=cdm robot=
May 19 12:19:59:732 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=537
May 19 12:19:59:732 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:19:59:732 [8520] cluster:  data   cdm=PDS(526)
May 19 12:19:59:732 [8520] cluster: (cmd_register_section) - OK - Probe 'cdm' found on local robot
May 19 12:19:59:732 [8520] cluster: sockClose:0000000000B43880:10.27.163.135/56142
May 19 12:19:59:732 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:19:59:732 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT50
May 19 12:19:59:732 [8520] cluster: (cmd_register_section) - Profile: /cluster/FRHDGSP-APBCT50/disk, Probe: cdm, Resource Group: FRHDGSP-APBCT50. Already registered
May 19 12:19:59:732 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT40
May 19 12:19:59:732 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: FRHDGSP-APBCT03
May 19 12:19:59:732 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: Cluster Group
May 19 12:19:59:733 [8520] cluster: (cmd_register_section) - Check existing resources for Resource Group: Available Storage
May 19 12:19:59:733 [8520] cluster:  (cmd_register_section) Releasing gRestartCallbackLock 
May 19 12:19:59:733 [8520] cluster: SREPLY: status = 1(error) ->10.27.163.135/56139
May 19 12:19:59:733 [8520] cluster:  head   mtype=200 status=1 seq=0
May 19 12:19:59:733 [8520] cluster: cmd_register_section(): - OUT
May 19 12:19:59:733 [8520] cluster: RREQUEST: _close <-10.27.163.135/56139  h=351 d=0
May 19 12:19:59:733 [8520] cluster: sockClose:0000000000B45660:10.27.163.135/48008
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:59:735 [8404] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:59:735 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:59:735 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:59:735 [8404] cluster: FindNode() End - OUT
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:59:735 [8404] cluster: FindGroup(): - IN
May 19 12:19:59:735 [8404] cluster: FindGroup(): - OUT
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - pds Deleted
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:59:735 [8404] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:59:735 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:59:735 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:59:735 [8404] cluster: FindNode() End - OUT
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:59:735 [8404] cluster: FindGroup(): - IN
May 19 12:19:59:735 [8404] cluster: FindGroup(): - OUT
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - pds Deleted
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:19:59:735 [8404] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:59:736 [8404] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:59:736 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:59:736 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:59:736 [8404] cluster: FindNode() End - OUT
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:59:736 [8404] cluster: FindGroup(): - IN
May 19 12:19:59:736 [8404] cluster: FindGroup(): - OUT
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - pds Deleted
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:59:736 [8404] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:59:736 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:59:736 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:59:736 [8404] cluster: FindNode() End - OUT
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:59:736 [8404] cluster: FindGroup(): - IN
May 19 12:19:59:736 [8404] cluster: FindGroup(): - OUT
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - pds Deleted
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:19:59:736 [8404] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:19:59:736 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:19:59:736 [8404] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:19:59:736 [8404] cluster: FindNode() End - OUT
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:19:59:736 [8404] cluster: FindGroup(): - IN
May 19 12:19:59:736 [8404] cluster: FindGroup(): - OUT
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Group state set to 0
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - pds Deleted
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Node Active set to True
May 19 12:19:59:736 [8404] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - starting
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckRestart - end
May 19 12:19:59:736 [8404] cluster: MapResourceGroups(): - OUT
May 19 12:19:59:736 [8404] cluster: doWork - check my resource groups
May 19 12:19:59:736 [8404] cluster: CheckMyResourceGroups(): - IN
May 19 12:19:59:736 [8404] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:19:59:736 [8404] cluster: CheckResourceGroup(): - IN
May 19 12:19:59:736 [8404] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:59:736 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:19:59:736 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:737 [8404] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:19:59:737 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:737 [8404] cluster: CheckResourceGroup(): - OUT
May 19 12:19:59:737 [8404] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:19:59:737 [8404] cluster: CheckResourceGroup(): - IN
May 19 12:19:59:737 [8404] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:59:737 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:737 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup(): - OUT
May 19 12:19:59:738 [8404] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup(): - IN
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:23 2020
 
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource - could not stat config file for probe cdm (C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg)
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:19:59:738 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:738 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:739 [8404] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:19:59:739 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:739 [8404] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:19:59:739 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:739 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:740 [8404] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:19:59:740 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:740 [8404] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:19:59:740 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:740 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:19:59:740 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:740 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:741 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\ size=476
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/error size=98
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/warning size=102
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/inode_error size=104
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/inode_warning size=108
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/missing size=85
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/delta_error size=105
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/F:\/delta_warning size=107
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:742 [8404] cluster: PdsFromSection(): - OUT
May 19 12:19:59:742 [8404] cluster: PdsMD5Sum - MD5=b9af1164c9c9a5d532f8b4fe8b80583a size=1340
May 19 12:19:59:742 [8404] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/disk/alarm/fixed/F:\ md5=b9af1164c9c9a5d532f8b4fe8b80583a
May 19 12:19:59:742 [8404] cluster: PdsSectionMD5(): - OUT
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:742 [8404] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:19:59:742 [8404] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource(): - IN
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:19:59:742 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:19:59:742 [8404] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:19:59:742 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:742 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\ size=476
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/error size=98
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/warning size=102
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/inode_error size=104
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/inode_warning size=108
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/missing size=85
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/delta_error size=105
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection - section=/disk/alarm/fixed/E:\/delta_warning size=107
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:744 [8404] cluster: PdsFromSection(): - OUT
May 19 12:19:59:744 [8404] cluster: PdsMD5Sum - MD5=6f30f24f08a9ed1eb14fcec1163f76b2 size=1340
May 19 12:19:59:744 [8404] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/disk/alarm/fixed/E:\ md5=6f30f24f08a9ed1eb14fcec1163f76b2
May 19 12:19:59:744 [8404] cluster: PdsSectionMD5(): - OUT
May 19 12:19:59:744 [8404] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:19:59:744 [8404] cluster: CheckResourceGroup(): - OUT
May 19 12:19:59:744 [8404] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:19:59:744 [8404] cluster: CheckResourceGroup(): - IN
May 19 12:19:59:744 [8404] cluster: CheckResourceGroup(): - OUT
May 19 12:19:59:744 [8404] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:19:59:744 [8404] cluster: CheckResourceGroup(): - IN
May 19 12:19:59:744 [8404] cluster: CheckResourceGroup(): - OUT
May 19 12:19:59:744 [8404] cluster: CheckConfigVersionPds(): - IN
May 19 12:19:59:744 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:744 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:745 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:745 [8404] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:19:59:745 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:745 [8404] cluster: PdsFromSection(): - OUT
May 19 12:19:59:745 [8404] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:19:59:745 [8404] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:19:59:745 [8404] cluster: PdsSectionMD5(): - OUT
May 19 12:19:59:745 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:745 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:745 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:745 [8404] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:19:59:745 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:745 [8404] cluster: PdsFromSection(): - OUT
May 19 12:19:59:745 [8404] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:19:59:745 [8404] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:19:59:745 [8404] cluster: PdsSectionMD5(): - OUT
May 19 12:19:59:745 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:745 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:746 [8404] cluster: PdsFromSection(): - OUT
May 19 12:19:59:746 [8404] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:19:59:746 [8404] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:19:59:746 [8404] cluster: PdsSectionMD5(): - OUT
May 19 12:19:59:746 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:746 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:747 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:747 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:747 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:747 [8404] cluster: PdsFromSection(): - OUT
May 19 12:19:59:747 [8404] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:19:59:747 [8404] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:19:59:747 [8404] cluster: PdsSectionMD5(): - OUT
May 19 12:19:59:747 [8404] cluster: PdsSectionMD5(): - IN
May 19 12:19:59:747 [8404] cluster: PdsFromSection(): - IN
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:747 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:747 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - IN
May 19 12:19:59:747 [8404] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:747 [8404] cluster: recursive_section2pds(): - OUT
May 19 12:19:59:747 [8404] cluster: PdsFromSection(): - OUT
May 19 12:19:59:747 [8404] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:19:59:747 [8404] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:19:59:747 [8404] cluster: PdsSectionMD5(): - OUT
May 19 12:19:59:747 [8404] cluster: CheckConfigVersionPds(): - OUT
May 19 12:19:59:747 [8404] cluster: CheckMyResourceGroups(): - OUT
May 19 12:19:59:747 [8404] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:00:442 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:01:443 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:01:735 [8520] cluster: (Main)update node & group conf is starting in thread 9096
May 19 12:20:01:735 [8520] cluster: main - adding Sleep 10
May 19 12:20:01:735 [9096] cluster: doWork(): - IN
May 19 12:20:01:735 [9096] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:02:443 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:03:444 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:03:737 [8520] cluster: (Main)update node & group conf is starting in thread 19204
May 19 12:20:03:737 [8520] cluster: main - adding Sleep 10
May 19 12:20:03:737 [19204] cluster: doWork(): - IN
May 19 12:20:03:737 [19204] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:04:445 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:05:446 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:05:738 [8520] cluster: (Main)update node & group conf is starting in thread 13388
May 19 12:20:05:738 [8520] cluster: main - adding Sleep 10
May 19 12:20:05:738 [13388] cluster: doWork(): - IN
May 19 12:20:05:738 [13388] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:06:446 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:07:447 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:07:739 [8520] cluster: (Main)update node & group conf is starting in thread 19572
May 19 12:20:07:739 [8520] cluster: main - adding Sleep 10
May 19 12:20:07:739 [19572] cluster: doWork(): - IN
May 19 12:20:07:739 [19572] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:08:448 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:09:449 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:09:741 [8520] cluster: (Main)update node & group conf is starting in thread 12040
May 19 12:20:09:741 [8520] cluster: main - adding Sleep 10
May 19 12:20:09:741 [12040] cluster: doWork(): - IN
May 19 12:20:09:741 [12040] cluster: doWork - check groups
May 19 12:20:09:741 [12040] cluster: MapResourceGroups(): - IN
May 19 12:20:09:741 [12040] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:09:764 [12040] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:09:764 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:09:764 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:09:764 [12040] cluster: FindNode() End - OUT
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:09:764 [12040] cluster: FindGroup(): - IN
May 19 12:20:09:764 [12040] cluster: FindGroup(): - OUT
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - pds Deleted
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:09:764 [12040] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:09:764 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:09:764 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:09:764 [12040] cluster: FindNode() End - OUT
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:09:764 [12040] cluster: FindGroup(): - IN
May 19 12:20:09:764 [12040] cluster: FindGroup(): - OUT
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - pds Deleted
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:09:764 [12040] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:09:764 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:09:764 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:09:764 [12040] cluster: FindNode() End - OUT
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:09:764 [12040] cluster: FindGroup(): - IN
May 19 12:20:09:764 [12040] cluster: FindGroup(): - OUT
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - pds Deleted
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:09:764 [12040] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:09:765 [12040] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:09:765 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:09:765 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:09:765 [12040] cluster: FindNode() End - OUT
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:09:765 [12040] cluster: FindGroup(): - IN
May 19 12:20:09:765 [12040] cluster: FindGroup(): - OUT
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - pds Deleted
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:09:765 [12040] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:09:765 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:09:765 [12040] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:09:765 [12040] cluster: FindNode() End - OUT
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:09:765 [12040] cluster: FindGroup(): - IN
May 19 12:20:09:765 [12040] cluster: FindGroup(): - OUT
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - pds Deleted
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Node Active set to True
May 19 12:20:09:765 [12040] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - starting
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckRestart - end
May 19 12:20:09:765 [12040] cluster: MapResourceGroups(): - OUT
May 19 12:20:09:765 [12040] cluster: doWork - check my resource groups
May 19 12:20:09:765 [12040] cluster: CheckMyResourceGroups(): - IN
May 19 12:20:09:765 [12040] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:20:09:765 [12040] cluster: CheckResourceGroup(): - IN
May 19 12:20:09:765 [12040] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:09:765 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:765 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:766 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:20:09:766 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:20:09:766 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:766 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:766 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages size=25
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuError size=264
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuWarning size=271
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuErrorProcesses size=331
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuWarningProcesses size=335
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuError-Ind size=263
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuWarning-Ind size=270
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuUserError size=270
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuUserWarning size=277
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuUserError-Ind size=269
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:767 [12040] cluster: PdsFromSection - section=/messages/CpuUserWarning-Ind size=276
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:767 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuSystemError size=276
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuSystemWarning size=283
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuSystemError-Ind size=275
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuSystemWarning-Ind size=289
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitError size=278
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning size=285
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitError-Ind size=277
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIdleError size=270
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIdleWarning size=277
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIdleError-Ind size=269
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuIdleWarning-Ind size=276
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuMultiMaxError size=223
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/CpuMultiDiffError size=308
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/PagefileError size=295
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/PagefileWarning size=299
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/PagingError size=264
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/PagingWarning size=271
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/PhysicalWarning size=290
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/PhysicalWarningProcesses size=342
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/SwapError size=272
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:768 [12040] cluster: PdsFromSection - section=/messages/SwapWarning size=279
May 19 12:20:09:768 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskError size=322
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskWarning size=326
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/InodeError size=282
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/InodeWarning size=289
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DeltaError size=210
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DeltaWarning size=214
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskMissing size=191
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskMounted size=185
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/ConnectionError size=186
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/ProcQueueLen size=275
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/BootAlarm size=201
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/InternalAlarm size=188
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskRateError size=256
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskRateWarning size=265
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskReadLatencyError size=274
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskReadLatencyWarning size=283
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskWriteLatencyWarning size=285
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskWriteLatencyError size=276
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskLatencyWarning size=274
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/DiskLatencyError size=265
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:769 [12040] cluster: PdsFromSection - section=/messages/NICRateError size=251
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:769 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/NICRateWarning size=260
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/SystemMemError size=278
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/SystemMemWarning size=286
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/UserMemError size=268
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/UserMemWarning size=278
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/AvailableWarning size=326
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/AvailableError size=316
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/PhysicalError size=286
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:770 [12040] cluster: PdsFromSection - section=/messages/PhysicalErrorProcesses size=336
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:770 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:770 [12040] cluster: PdsMD5Sum - MD5=c6e9bbecf1e1ebfadd6fbbb1649f880f size=17669
May 19 12:20:09:770 [12040] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/messages md5=c6e9bbecf1e1ebfadd6fbbb1649f880f
May 19 12:20:09:770 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:770 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:770 [12040] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:20:09:770 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:09:770 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:770 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:771 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:20:09:771 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:20:09:771 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:771 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:771 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk size=45
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm size=51
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed size=57
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\ size=480
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/error size=122
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/warning size=126
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_error size=128
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/inode_warning size=132
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:772 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:772 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/missing size=109
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:773 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_error size=129
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:773 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT50/disk/alarm/fixed/I:\/delta_warning size=131
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:773 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:773 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:773 [12040] cluster: PdsMD5Sum - MD5=724d51f8f325b7b153386bf28a354f38 size=1692
May 19 12:20:09:773 [12040] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/cluster/FRHDGSP-APBCT50/disk md5=724d51f8f325b7b153386bf28a354f38
May 19 12:20:09:773 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:773 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:773 [12040] cluster: CheckResourceGroup(): - OUT
May 19 12:20:09:773 [12040] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:20:09:773 [12040] cluster: CheckResourceGroup(): - IN
May 19 12:20:09:773 [12040] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:09:773 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:09:773 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:773 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:773 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:20:09:773 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:20:09:773 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:773 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:773 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:774 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages size=25
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuError size=264
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuWarning size=271
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuErrorProcesses size=331
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuWarningProcesses size=335
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuError-Ind size=263
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuWarning-Ind size=270
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuUserError size=270
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuUserWarning size=277
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuUserError-Ind size=269
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuUserWarning-Ind size=276
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuSystemError size=276
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuSystemWarning size=283
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuSystemError-Ind size=275
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuSystemWarning-Ind size=289
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitError size=278
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning size=285
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitError-Ind size=277
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:775 [12040] cluster: PdsFromSection - section=/messages/CpuIdleError size=270
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:775 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/CpuIdleWarning size=277
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/CpuIdleError-Ind size=269
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/CpuIdleWarning-Ind size=276
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/CpuMultiMaxError size=223
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/CpuMultiDiffError size=308
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/PagefileError size=295
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/PagefileWarning size=299
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/PagingError size=264
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/PagingWarning size=271
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/PhysicalWarning size=290
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/PhysicalWarningProcesses size=342
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/SwapError size=272
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/SwapWarning size=279
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/DiskError size=322
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/DiskWarning size=326
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/InodeError size=282
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/InodeWarning size=289
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/DeltaError size=210
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/DeltaWarning size=214
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/DiskMissing size=191
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/DiskMounted size=185
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:776 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:776 [12040] cluster: PdsFromSection - section=/messages/ConnectionError size=186
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/ProcQueueLen size=275
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/BootAlarm size=201
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/InternalAlarm size=188
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskRateError size=256
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskRateWarning size=265
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskReadLatencyError size=274
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskReadLatencyWarning size=283
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskWriteLatencyWarning size=285
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskWriteLatencyError size=276
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskLatencyWarning size=274
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/DiskLatencyError size=265
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/NICRateError size=251
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/NICRateWarning size=260
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/SystemMemError size=278
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/SystemMemWarning size=286
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/UserMemError size=268
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/UserMemWarning size=278
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/AvailableWarning size=326
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:777 [12040] cluster: PdsFromSection - section=/messages/AvailableError size=316
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:777 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:778 [12040] cluster: PdsFromSection - section=/messages/PhysicalError size=286
May 19 12:20:09:778 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:778 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:778 [12040] cluster: PdsFromSection - section=/messages/PhysicalErrorProcesses size=336
May 19 12:20:09:778 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:778 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:778 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:778 [12040] cluster: PdsMD5Sum - MD5=c6e9bbecf1e1ebfadd6fbbb1649f880f size=17669
May 19 12:20:09:778 [12040] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/messages md5=c6e9bbecf1e1ebfadd6fbbb1649f880f
May 19 12:20:09:778 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:778 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:778 [12040] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:20:09:778 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:09:778 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:778 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:778 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:20:09:778 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:20:09:778 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:778 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:778 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk size=45
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm size=51
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed size=57
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\ size=483
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/error size=122
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/warning size=126
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_error size=128
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/inode_warning size=132
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/missing size=109
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_error size=129
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:780 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT40/disk/alarm/fixed/G:\/delta_warning size=131
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:780 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:780 [12040] cluster: PdsMD5Sum - MD5=71cc6d1723640b6ee3340d617c298977 size=1695
May 19 12:20:09:780 [12040] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/cluster/FRHDGSP-APBCT40/disk md5=71cc6d1723640b6ee3340d617c298977
May 19 12:20:09:780 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:780 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:780 [12040] cluster: CheckResourceGroup(): - OUT
May 19 12:20:09:780 [12040] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:20:09:780 [12040] cluster: CheckResourceGroup(): - IN
May 19 12:20:09:780 [12040] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:09:780 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:780 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:780 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:781 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:20:09:781 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:20:09:781 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:781 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:781 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages size=25
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuError size=264
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuWarning size=271
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuErrorProcesses size=331
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuWarningProcesses size=335
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuError-Ind size=263
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuWarning-Ind size=270
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuUserError size=270
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuUserWarning size=277
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuUserError-Ind size=269
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:782 [12040] cluster: PdsFromSection - section=/messages/CpuUserWarning-Ind size=276
May 19 12:20:09:782 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuSystemError size=276
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuSystemWarning size=283
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuSystemError-Ind size=275
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuSystemWarning-Ind size=289
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitError size=278
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning size=285
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitError-Ind size=277
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIOWaitWarning-Ind size=284
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIdleError size=270
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIdleWarning size=277
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIdleError-Ind size=269
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuIdleWarning-Ind size=276
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuMultiMaxError size=223
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/CpuMultiDiffError size=308
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/PagefileError size=295
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/PagefileWarning size=299
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/PagingError size=264
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/PagingWarning size=271
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/PhysicalWarning size=290
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/PhysicalWarningProcesses size=342
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:783 [12040] cluster: PdsFromSection - section=/messages/SwapError size=272
May 19 12:20:09:783 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/SwapWarning size=279
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskError size=322
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskWarning size=326
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/InodeError size=282
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/InodeWarning size=289
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DeltaError size=210
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DeltaWarning size=214
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskMissing size=191
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskMounted size=185
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/ConnectionError size=186
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/ProcQueueLen size=275
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/BootAlarm size=201
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/InternalAlarm size=188
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskRateError size=256
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskRateWarning size=265
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskReadLatencyError size=274
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskReadLatencyWarning size=283
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskWriteLatencyWarning size=285
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskWriteLatencyError size=276
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskLatencyWarning size=274
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:784 [12040] cluster: PdsFromSection - section=/messages/DiskLatencyError size=265
May 19 12:20:09:784 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/NICRateError size=251
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/NICRateWarning size=260
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/SystemMemError size=278
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/SystemMemWarning size=286
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/UserMemError size=268
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/UserMemWarning size=278
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/AvailableWarning size=326
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/AvailableError size=316
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/PhysicalError size=286
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:785 [12040] cluster: PdsFromSection - section=/messages/PhysicalErrorProcesses size=336
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:785 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:785 [12040] cluster: PdsMD5Sum - MD5=c6e9bbecf1e1ebfadd6fbbb1649f880f size=17669
May 19 12:20:09:785 [12040] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/messages md5=c6e9bbecf1e1ebfadd6fbbb1649f880f
May 19 12:20:09:785 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:785 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:785 [12040] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:20:09:785 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:785 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:785 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:786 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:20:09:786 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:23 2020
 
May 19 12:20:09:786 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:786 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:786 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk size=45
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm size=51
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed size=57
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\ size=484
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/error size=122
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning size=126
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error size=128
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning size=132
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/missing size=109
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/warning size=126
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_error size=128
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/inode_warning size=132
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/missing size=109
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_error size=129
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/E:\/delta_warning size=131
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:787 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\ size=487
May 19 12:20:09:787 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/error size=122
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/warning size=126
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_error size=128
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/inode_warning size=132
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/missing size=109
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_error size=129
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/F:\/delta_warning size=131
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\ size=485
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/error size=122
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/warning size=126
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_error size=128
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/inode_warning size=132
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/missing size=109
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_error size=129
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:788 [12040] cluster: PdsFromSection - section=/cluster/FRHDGSP-APBCT03/disk/alarm/fixed/H:\/delta_warning size=131
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:788 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:788 [12040] cluster: PdsMD5Sum - MD5=838c44e54cb6c0807f04815c8cb48393 size=4582
May 19 12:20:09:788 [12040] cluster: PdsSectionMD5 - file=C:\Program Files\Nimsoft\probes/system/cdm\cdm.cfg section=/cluster/FRHDGSP-APBCT03/disk md5=838c44e54cb6c0807f04815c8cb48393
May 19 12:20:09:788 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:788 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:788 [12040] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:20:09:788 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:788 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:789 [12040] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:20:09:789 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:789 [12040] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:20:09:789 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:09:789 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:789 [12040] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:20:09:789 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:790 [12040] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:20:09:790 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:790 [12040] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:20:09:790 [12040] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:09:790 [12040] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:09:790 [12040] cluster: CheckResourceGroup(): - OUT
May 19 12:20:09:791 [12040] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:20:09:791 [12040] cluster: CheckResourceGroup(): - IN
May 19 12:20:09:791 [12040] cluster: CheckResourceGroup(): - OUT
May 19 12:20:09:791 [12040] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:20:09:791 [12040] cluster: CheckResourceGroup(): - IN
May 19 12:20:09:791 [12040] cluster: CheckResourceGroup(): - OUT
May 19 12:20:09:791 [12040] cluster: CheckConfigVersionPds(): - IN
May 19 12:20:09:791 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:791 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:791 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:791 [12040] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:20:09:791 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:791 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:791 [12040] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:20:09:791 [12040] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:20:09:791 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:791 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:791 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:792 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:792 [12040] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:20:09:792 [12040] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:20:09:792 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:792 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:792 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:20:09:792 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:793 [12040] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:20:09:793 [12040] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:20:09:793 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:793 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:793 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:793 [12040] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:20:09:793 [12040] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:20:09:793 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:793 [12040] cluster: PdsSectionMD5(): - IN
May 19 12:20:09:793 [12040] cluster: PdsFromSection(): - IN
May 19 12:20:09:794 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:794 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:20:09:794 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:794 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:20:09:794 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:794 [12040] cluster: recursive_section2pds(): - IN
May 19 12:20:09:794 [12040] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:20:09:794 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:794 [12040] cluster: recursive_section2pds(): - OUT
May 19 12:20:09:794 [12040] cluster: PdsFromSection(): - OUT
May 19 12:20:09:794 [12040] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:20:09:794 [12040] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:20:09:794 [12040] cluster: PdsSectionMD5(): - OUT
May 19 12:20:09:794 [12040] cluster: CheckConfigVersionPds(): - OUT
May 19 12:20:09:794 [12040] cluster: CheckMyResourceGroups(): - OUT
May 19 12:20:09:794 [12040] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:10:450 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:11:451 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:11:743 [8520] cluster: (Main)update node & group conf is starting in thread 14896
May 19 12:20:11:743 [8520] cluster: main - adding Sleep 10
May 19 12:20:11:743 [14896] cluster: doWork(): - IN
May 19 12:20:11:743 [14896] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:12:451 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:13:452 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:13:745 [8520] cluster: (Main)update node & group conf is starting in thread 14276
May 19 12:20:13:745 [8520] cluster: main - adding Sleep 10
May 19 12:20:13:745 [14276] cluster: doWork(): - IN
May 19 12:20:13:745 [14276] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:14:453 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:15:454 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:15:746 [8520] cluster: (Main)update node & group conf is starting in thread 19676
May 19 12:20:15:746 [8520] cluster: main - adding Sleep 10
May 19 12:20:15:746 [19676] cluster: doWork(): - IN
May 19 12:20:15:746 [19676] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:16:455 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:17:456 [20420] cluster: update node & group conf is starting in thread 4548
May 19 12:20:17:456 [4548] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:20:17:456 [4548] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:20:17:456 [4548] cluster: child udp_thread
May 19 12:20:17:456 [4548] cluster: child udp - Update node configs
May 19 12:20:17:456 [4548] cluster: updateNodeConf(): - IN
May 19 12:20:17:456 [4548] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:20:17:456 [4548] cluster: NodeConfigurationRequest(): - IN
May 19 12:20:17:456 [4548] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:20:17:456 [4548] cluster: PdsFromSection(): - IN
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster size=74
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - IN
May 19 12:20:17:457 [4548] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: recursive_section2pds(): - OUT
May 19 12:20:17:457 [4548] cluster: PdsFromSection(): - OUT
May 19 12:20:17:457 [4548] cluster: NodeConfigurationRequest(): - OUT
May 19 12:20:17:457 [4548] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:20:17:748 [8520] cluster: (Main)update node & group conf is starting in thread 9868
May 19 12:20:17:748 [8520] cluster: main - adding Sleep 10
May 19 12:20:17:748 [9868] cluster: doWork(): - IN
May 19 12:20:17:748 [9868] cluster: doWork - check nodes - do connection
May 19 12:20:17:748 [9868] cluster: ConnectAllNodes(): - IN
May 19 12:20:17:748 [9868] cluster: (ConnectAllNodes) - Start
May 19 12:20:17:748 [9868] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:20:17:748 [9868] cluster: ConnectToNode(): - IN
May 19 12:20:17:748 [9868] cluster: controller port is 48000
May 19 12:20:18:435 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:18:435 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56544  h=298 d=1417
May 19 12:20:18:435 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:20:18:435 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:20:18:435 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:20:18:435 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:20:18:435 [20420] cluster: set_node_version - from 10.27.163.134/56544 [0xb7f1c0]
May 19 12:20:18:435 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:20:18:435 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:20:18:435 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56544
May 19 12:20:18:435 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:20:18:436 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:20:18:436 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:20:18:436 [20420] cluster: RREQUEST: _close <-10.27.163.134/56544  h=287 d=0
May 19 12:20:18:436 [20420] cluster: sockClose:0000000000B7F1C0:10.27.163.135/48003
May 19 12:20:18:437 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56545  h=299 d=866
May 19 12:20:18:437 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:20:18:437 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:20:18:437 [20420] cluster: set_group_version - from 10.27.163.134/56545 [0xb7f1c0]
May 19 12:20:18:437 [20420] cluster: set_group_version - pds received, size=866
May 19 12:20:18:437 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:20:18:437 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:20:18:437 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:20:18:437 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:20:18:437 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:20:18:437 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:20:18:437 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:20:18:437 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:20:18:437 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:20:18:437 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:20:18:437 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:20:18:437 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:20:18:437 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56545
May 19 12:20:18:437 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:20:18:437 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:20:18:437 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:20:18:438 [20420] cluster: RREQUEST: _close <-10.27.163.134/56545  h=287 d=0
May 19 12:20:18:438 [20420] cluster: sockClose:0000000000B7F1C0:10.27.163.135/48003
May 19 12:20:19:439 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:19:750 [8520] cluster: main - adding Sleep 10
May 19 12:20:20:439 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:21:440 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:21:751 [8520] cluster: main - adding Sleep 10
May 19 12:20:22:441 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:22:748 [9868] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:20:22:748 [9868] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:20:22:748 [9868] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:20:22:748 [9868] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:20:22:748 [9868] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:20:22:748 [9868] cluster: ConnectAllNodes(): - OUT
May 19 12:20:22:748 [9868] cluster: Not connected to any nodes!
May 19 12:20:22:748 [9868] cluster: doWork - check nodes - state
May 19 12:20:22:748 [9868] cluster: CheckNodeState(): - Starting IN
May 19 12:20:22:753 [9868] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:22:753 [9868] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:22:753 [9868] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:22:753 [9868] cluster: FindNode() End - OUT
May 19 12:20:22:753 [9868] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:20:22:753 [9868] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:20:22:753 [9868] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:22:753 [9868] cluster: FindNode() End - OUT
May 19 12:20:22:753 [9868] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:20:22:753 [9868] cluster: CheckNodeState(): - OUT
May 19 12:20:22:753 [9868] cluster: doWork - check nodes - any new probes installed
May 19 12:20:22:753 [9868] cluster: ProbeInfoCheck(): - IN
May 19 12:20:22:753 [9868] cluster: ProbeInfoCheck(): - OUT
May 19 12:20:22:753 [9868] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:23:442 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:23:753 [8520] cluster: (Main)update node & group conf is starting in thread 18768
May 19 12:20:23:753 [8520] cluster: main - adding Sleep 10
May 19 12:20:23:753 [18768] cluster: doWork(): - IN
May 19 12:20:23:753 [18768] cluster: doWork - check groups
May 19 12:20:23:753 [18768] cluster: MapResourceGroups(): - IN
May 19 12:20:23:753 [18768] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:23:775 [18768] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:23:775 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:23:775 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:23:775 [18768] cluster: FindNode() End - OUT
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:23:775 [18768] cluster: FindGroup(): - IN
May 19 12:20:23:775 [18768] cluster: FindGroup(): - OUT
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - pds Deleted
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:23:775 [18768] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:23:775 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:23:775 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:23:775 [18768] cluster: FindNode() End - OUT
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:23:775 [18768] cluster: FindGroup(): - IN
May 19 12:20:23:775 [18768] cluster: FindGroup(): - OUT
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - pds Deleted
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:20:23:775 [18768] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:23:776 [18768] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:23:776 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:23:776 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:23:776 [18768] cluster: FindNode() End - OUT
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:23:776 [18768] cluster: FindGroup(): - IN
May 19 12:20:23:776 [18768] cluster: FindGroup(): - OUT
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - pds Deleted
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:23:776 [18768] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:23:776 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:23:776 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:23:776 [18768] cluster: FindNode() End - OUT
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:23:776 [18768] cluster: FindGroup(): - IN
May 19 12:20:23:776 [18768] cluster: FindGroup(): - OUT
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - pds Deleted
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:23:776 [18768] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:23:776 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:23:776 [18768] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:23:776 [18768] cluster: FindNode() End - OUT
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:23:776 [18768] cluster: FindGroup(): - IN
May 19 12:20:23:776 [18768] cluster: FindGroup(): - OUT
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - pds Deleted
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Node Active set to True
May 19 12:20:23:776 [18768] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - starting
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckRestart - end
May 19 12:20:23:776 [18768] cluster: MapResourceGroups(): - OUT
May 19 12:20:23:776 [18768] cluster: doWork - check my resource groups
May 19 12:20:23:776 [18768] cluster: CheckMyResourceGroups(): - IN
May 19 12:20:23:776 [18768] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:20:23:776 [18768] cluster: CheckResourceGroup(): - IN
May 19 12:20:23:776 [18768] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:23:776 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:23:776 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:777 [18768] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:20:23:777 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:777 [18768] cluster: CheckResourceGroup(): - OUT
May 19 12:20:23:777 [18768] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:20:23:777 [18768] cluster: CheckResourceGroup(): - IN
May 19 12:20:23:777 [18768] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:23:777 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:777 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup(): - OUT
May 19 12:20:23:778 [18768] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup(): - IN
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:20:23:778 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:778 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:779 [18768] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:20:23:779 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:779 [18768] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:20:23:779 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:779 [18768] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:20:23:779 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:779 [18768] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:780 [18768] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:20:23:780 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:780 [18768] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:20:23:780 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:780 [18768] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:20:23:780 [18768] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:23:780 [18768] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:23:781 [18768] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:20:23:781 [18768] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:781 [18768] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:23:781 [18768] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:23:781 [18768] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:23:781 [18768] cluster: CheckResourceGroup(): - OUT
May 19 12:20:23:781 [18768] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:20:23:781 [18768] cluster: CheckResourceGroup(): - IN
May 19 12:20:23:781 [18768] cluster: CheckResourceGroup(): - OUT
May 19 12:20:23:781 [18768] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:20:23:781 [18768] cluster: CheckResourceGroup(): - IN
May 19 12:20:23:781 [18768] cluster: CheckResourceGroup(): - OUT
May 19 12:20:23:781 [18768] cluster: CheckConfigVersionPds(): - IN
May 19 12:20:23:781 [18768] cluster: PdsSectionMD5(): - IN
May 19 12:20:23:781 [18768] cluster: PdsFromSection(): - IN
May 19 12:20:23:781 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:781 [18768] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:20:23:781 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:781 [18768] cluster: PdsFromSection(): - OUT
May 19 12:20:23:781 [18768] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:20:23:781 [18768] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:20:23:781 [18768] cluster: PdsSectionMD5(): - OUT
May 19 12:20:23:781 [18768] cluster: PdsSectionMD5(): - IN
May 19 12:20:23:781 [18768] cluster: PdsFromSection(): - IN
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:782 [18768] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:782 [18768] cluster: PdsFromSection(): - OUT
May 19 12:20:23:782 [18768] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:20:23:782 [18768] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:20:23:782 [18768] cluster: PdsSectionMD5(): - OUT
May 19 12:20:23:782 [18768] cluster: PdsSectionMD5(): - IN
May 19 12:20:23:782 [18768] cluster: PdsFromSection(): - IN
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:782 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:782 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:782 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:782 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: PdsFromSection(): - OUT
May 19 12:20:23:783 [18768] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:20:23:783 [18768] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:20:23:783 [18768] cluster: PdsSectionMD5(): - OUT
May 19 12:20:23:783 [18768] cluster: PdsSectionMD5(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection(): - IN
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:783 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:783 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:784 [18768] cluster: PdsFromSection(): - OUT
May 19 12:20:23:784 [18768] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:20:23:784 [18768] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:20:23:784 [18768] cluster: PdsSectionMD5(): - OUT
May 19 12:20:23:784 [18768] cluster: PdsSectionMD5(): - IN
May 19 12:20:23:784 [18768] cluster: PdsFromSection(): - IN
May 19 12:20:23:784 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:784 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:20:23:784 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:784 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:20:23:784 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:784 [18768] cluster: recursive_section2pds(): - IN
May 19 12:20:23:784 [18768] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:20:23:784 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:784 [18768] cluster: recursive_section2pds(): - OUT
May 19 12:20:23:784 [18768] cluster: PdsFromSection(): - OUT
May 19 12:20:23:784 [18768] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:20:23:784 [18768] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:20:23:784 [18768] cluster: PdsSectionMD5(): - OUT
May 19 12:20:23:784 [18768] cluster: CheckConfigVersionPds(): - OUT
May 19 12:20:23:784 [18768] cluster: CheckMyResourceGroups(): - OUT
May 19 12:20:23:784 [18768] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:24:443 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:25:444 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:25:755 [8520] cluster: (Main)update node & group conf is starting in thread 4036
May 19 12:20:25:755 [8520] cluster: main - adding Sleep 10
May 19 12:20:25:755 [4036] cluster: doWork(): - IN
May 19 12:20:25:755 [4036] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:26:444 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:27:445 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:27:756 [8520] cluster: (Main)update node & group conf is starting in thread 18072
May 19 12:20:27:756 [8520] cluster: main - adding Sleep 10
May 19 12:20:27:756 [18072] cluster: doWork(): - IN
May 19 12:20:27:756 [18072] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:28:446 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:29:447 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:29:758 [8520] cluster: (Main)update node & group conf is starting in thread 13228
May 19 12:20:29:758 [8520] cluster: main - adding Sleep 10
May 19 12:20:29:758 [13228] cluster: doWork(): - IN
May 19 12:20:29:758 [13228] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:30:448 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:30:681 [8520] cluster: RREQUEST: set_node_up <-10.27.163.134/56555  h=293 d=106
May 19 12:20:30:681 [8520] cluster: nimSockaddr2Ip - found 10.27.163.134
May 19 12:20:30:681 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:20:30:684 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:20:30:684 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:20:30:684 [8520] cluster:  data   time=1589883630 access=2 ident=30764
May 19 12:20:30:684 [8520] cluster: sockClose:0000000000B7F1C0:10.27.163.135/56173
May 19 12:20:30:684 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:20:30:684 [8520] cluster: cmd_set_node_up(): - IN
May 19 12:20:30:684 [8520] cluster: set_node_up - from 10.27.163.134/56555 [0xb7dd00]
May 19 12:20:30:685 [8520] cluster: cmd_set_node_up(): - OUT
May 19 12:20:30:685 [22360] cluster: thrSetNodeUp(): - IN
May 19 12:20:30:685 [22360] cluster:  (thrSetNodeUp) Waiting gthreadCallbackLock 
May 19 12:20:30:685 [22360] cluster:  (thrSetNodeUp) Locking gthreadCallbackLock 
May 19 12:20:30:685 [22360] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:20:30:685 [22360] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:30:685 [22360] cluster: FindNode() End - OUT
May 19 12:20:30:685 [22360] cluster: thrSetNodeUp - Caller address: /TotalDxim/SDCPPDXIM07/frhdstd-apbct01/cluster, My adress: 10.27.163.135
May 19 12:20:30:685 [22360] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56555
May 19 12:20:30:685 [22360] cluster:  head   mtype=200 status=0 seq=0
May 19 12:20:30:685 [22360] cluster: sockClose:0000000000B7DD00:10.27.163.135/48008
May 19 12:20:30:685 [22360] cluster: SREQUEST: _close ->10.27.163.134/56555
May 19 12:20:30:685 [22360] cluster:  (thrSetNodeUp) Releasing gthreadCallbackLock 
May 19 12:20:30:685 [22360] cluster: thrSetNodeUp(): - OUT
May 19 12:20:31:449 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:31:686 [8520] cluster: (Main)update node & group conf is starting in thread 22432
May 19 12:20:31:686 [8520] cluster: main - adding Sleep 10
May 19 12:20:31:686 [22432] cluster: doWork(): - IN
May 19 12:20:31:686 [22432] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:32:449 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:33:450 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:33:687 [8520] cluster: (Main)update node & group conf is starting in thread 22408
May 19 12:20:33:687 [8520] cluster: main - adding Sleep 10
May 19 12:20:33:687 [22408] cluster: doWork(): - IN
May 19 12:20:33:687 [22408] cluster: doWork - check groups
May 19 12:20:33:687 [22408] cluster: MapResourceGroups(): - IN
May 19 12:20:33:687 [22408] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:33:709 [22408] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:33:709 [22408] cluster: FindNode() End - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:33:709 [22408] cluster: FindGroup(): - IN
May 19 12:20:33:709 [22408] cluster: FindGroup(): - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - pds Deleted
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:33:709 [22408] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:33:709 [22408] cluster: FindNode() End - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:33:709 [22408] cluster: FindGroup(): - IN
May 19 12:20:33:709 [22408] cluster: FindGroup(): - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - pds Deleted
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:33:709 [22408] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:33:709 [22408] cluster: FindNode() End - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:33:709 [22408] cluster: FindGroup(): - IN
May 19 12:20:33:709 [22408] cluster: FindGroup(): - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - pds Deleted
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:33:709 [22408] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:33:709 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:33:709 [22408] cluster: FindNode() End - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:33:709 [22408] cluster: FindGroup(): - IN
May 19 12:20:33:709 [22408] cluster: FindGroup(): - OUT
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:20:33:709 [22408] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - pds Deleted
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:33:710 [22408] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:33:710 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:33:710 [22408] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:33:710 [22408] cluster: FindNode() End - OUT
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:33:710 [22408] cluster: FindGroup(): - IN
May 19 12:20:33:710 [22408] cluster: FindGroup(): - OUT
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - pds Deleted
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Node Active set to True
May 19 12:20:33:710 [22408] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - starting
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckRestart - end
May 19 12:20:33:710 [22408] cluster: MapResourceGroups(): - OUT
May 19 12:20:33:710 [22408] cluster: doWork - check my resource groups
May 19 12:20:33:710 [22408] cluster: CheckMyResourceGroups(): - IN
May 19 12:20:33:710 [22408] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:20:33:710 [22408] cluster: CheckResourceGroup(): - IN
May 19 12:20:33:710 [22408] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:33:710 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:710 [22408] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:20:33:710 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:33:710 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup(): - OUT
May 19 12:20:33:711 [22408] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup(): - IN
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:711 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup(): - OUT
May 19 12:20:33:711 [22408] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:20:33:711 [22408] cluster: CheckResourceGroup(): - IN
May 19 12:20:33:712 [22408] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:33:712 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:712 [22408] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:20:33:712 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:712 [22408] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:20:33:712 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:712 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:712 [22408] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:20:33:713 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:713 [22408] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:20:33:713 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:713 [22408] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:20:33:713 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:713 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:713 [22408] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:20:33:713 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:33:714 [22408] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup(): - OUT
May 19 12:20:33:714 [22408] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup(): - IN
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup(): - OUT
May 19 12:20:33:714 [22408] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup(): - IN
May 19 12:20:33:714 [22408] cluster: CheckResourceGroup(): - OUT
May 19 12:20:33:714 [22408] cluster: CheckConfigVersionPds(): - IN
May 19 12:20:33:714 [22408] cluster: PdsSectionMD5(): - IN
May 19 12:20:33:714 [22408] cluster: PdsFromSection(): - IN
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsFromSection(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection(): - IN
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsFromSection(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection(): - IN
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsFromSection(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5(): - OUT
May 19 12:20:33:716 [22408] cluster: PdsSectionMD5(): - IN
May 19 12:20:33:716 [22408] cluster: PdsFromSection(): - IN
May 19 12:20:33:717 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:717 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:20:33:717 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:717 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:20:33:717 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:717 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:717 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:20:33:717 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:717 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:717 [22408] cluster: PdsFromSection(): - OUT
May 19 12:20:33:717 [22408] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:20:33:717 [22408] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:20:33:717 [22408] cluster: PdsSectionMD5(): - OUT
May 19 12:20:33:717 [22408] cluster: PdsSectionMD5(): - IN
May 19 12:20:33:717 [22408] cluster: PdsFromSection(): - IN
May 19 12:20:33:717 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:718 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:20:33:718 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:718 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:20:33:718 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:718 [22408] cluster: recursive_section2pds(): - IN
May 19 12:20:33:718 [22408] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:20:33:718 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:718 [22408] cluster: recursive_section2pds(): - OUT
May 19 12:20:33:718 [22408] cluster: PdsFromSection(): - OUT
May 19 12:20:33:718 [22408] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:20:33:718 [22408] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:20:33:718 [22408] cluster: PdsSectionMD5(): - OUT
May 19 12:20:33:718 [22408] cluster: CheckConfigVersionPds(): - OUT
May 19 12:20:33:718 [22408] cluster: CheckMyResourceGroups(): - OUT
May 19 12:20:33:718 [22408] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:34:451 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:35:452 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:35:689 [8520] cluster: (Main)update node & group conf is starting in thread 19144
May 19 12:20:35:689 [8520] cluster: main - adding Sleep 10
May 19 12:20:35:689 [19144] cluster: doWork(): - IN
May 19 12:20:35:689 [19144] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:36:453 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:37:454 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:37:691 [8520] cluster: (Main)update node & group conf is starting in thread 13796
May 19 12:20:37:691 [8520] cluster: main - adding Sleep 10
May 19 12:20:37:691 [13796] cluster: doWork(): - IN
May 19 12:20:37:691 [13796] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:38:454 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:38:459 [4548] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:20:38:459 [4548] cluster: (updateNodeConf) - Connect to ip/host: 10.30.10.16
May 19 12:20:38:459 [4548] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:20:38:459 [4548] cluster: updateNodeConf(): - OUT
May 19 12:20:38:459 [4548] cluster: child udp - Update group configs
May 19 12:20:38:459 [4548] cluster: updateGroupConf(): - IN
May 19 12:20:38:459 [4548] cluster: (updateGroupConf) - This node ip/host: 10.27.163.135
May 19 12:20:38:459 [4548] cluster: ResourceGroupConfigurationRequest(): - IN
May 19 12:20:38:459 [4548] cluster: ResourceGroupConfigurationRequest(): - OUT
May 19 12:20:38:459 [4548] cluster: (updateGroupConf) - Connect to ip/host: 10.30.10.16, port: 48003
May 19 12:20:39:455 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:39:693 [8520] cluster: (Main)update node & group conf is starting in thread 11456
May 19 12:20:39:693 [8520] cluster: main - adding Sleep 10
May 19 12:20:39:693 [11456] cluster: doWork(): - IN
May 19 12:20:39:693 [11456] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:40:456 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:41:457 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:41:694 [8520] cluster: (Main)update node & group conf is starting in thread 13880
May 19 12:20:41:694 [8520] cluster: main - adding Sleep 10
May 19 12:20:41:694 [13880] cluster: doWork(): - IN
May 19 12:20:41:694 [13880] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:42:458 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:43:459 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:43:696 [8520] cluster: (Main)update node & group conf is starting in thread 8508
May 19 12:20:43:696 [8520] cluster: main - adding Sleep 10
May 19 12:20:43:696 [8508] cluster: doWork(): - IN
May 19 12:20:43:696 [8508] cluster: doWork - check groups
May 19 12:20:43:696 [8508] cluster: MapResourceGroups(): - IN
May 19 12:20:43:696 [8508] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:43:718 [8508] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:43:718 [8508] cluster: FindNode() End - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:43:718 [8508] cluster: FindGroup(): - IN
May 19 12:20:43:718 [8508] cluster: FindGroup(): - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - pds Deleted
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:43:718 [8508] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:43:718 [8508] cluster: FindNode() End - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:43:718 [8508] cluster: FindGroup(): - IN
May 19 12:20:43:718 [8508] cluster: FindGroup(): - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - pds Deleted
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:43:718 [8508] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:43:718 [8508] cluster: FindNode() End - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:43:718 [8508] cluster: FindGroup(): - IN
May 19 12:20:43:718 [8508] cluster: FindGroup(): - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - pds Deleted
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:43:718 [8508] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:43:718 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:43:718 [8508] cluster: FindNode() End - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:43:718 [8508] cluster: FindGroup(): - IN
May 19 12:20:43:718 [8508] cluster: FindGroup(): - OUT
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - pds Deleted
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:43:718 [8508] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:43:719 [8508] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:43:719 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:43:719 [8508] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:43:719 [8508] cluster: FindNode() End - OUT
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:43:719 [8508] cluster: FindGroup(): - IN
May 19 12:20:43:719 [8508] cluster: FindGroup(): - OUT
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - pds Deleted
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - Node Active set to True
May 19 12:20:43:719 [8508] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - starting
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckRestart - end
May 19 12:20:43:719 [8508] cluster: MapResourceGroups(): - OUT
May 19 12:20:43:719 [8508] cluster: doWork - check my resource groups
May 19 12:20:43:719 [8508] cluster: CheckMyResourceGroups(): - IN
May 19 12:20:43:719 [8508] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:20:43:719 [8508] cluster: CheckResourceGroup(): - IN
May 19 12:20:43:719 [8508] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:43:719 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:719 [8508] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:20:43:719 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:719 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup(): - OUT
May 19 12:20:43:720 [8508] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup(): - IN
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup(): - OUT
May 19 12:20:43:720 [8508] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup(): - IN
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:20:43:720 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:720 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:721 [8508] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:20:43:721 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:721 [8508] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:20:43:721 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:721 [8508] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:20:43:721 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:20:43:721 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:43:722 [8508] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup(): - OUT
May 19 12:20:43:722 [8508] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup(): - IN
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup(): - OUT
May 19 12:20:43:722 [8508] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup(): - IN
May 19 12:20:43:722 [8508] cluster: CheckResourceGroup(): - OUT
May 19 12:20:43:722 [8508] cluster: CheckConfigVersionPds(): - IN
May 19 12:20:43:722 [8508] cluster: PdsSectionMD5(): - IN
May 19 12:20:43:723 [8508] cluster: PdsFromSection(): - IN
May 19 12:20:43:723 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:723 [8508] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:20:43:723 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:723 [8508] cluster: PdsFromSection(): - OUT
May 19 12:20:43:723 [8508] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:20:43:723 [8508] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:20:43:723 [8508] cluster: PdsSectionMD5(): - OUT
May 19 12:20:43:723 [8508] cluster: PdsSectionMD5(): - IN
May 19 12:20:43:723 [8508] cluster: PdsFromSection(): - IN
May 19 12:20:43:723 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:723 [8508] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:20:43:723 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: PdsFromSection(): - OUT
May 19 12:20:43:724 [8508] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:20:43:724 [8508] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:20:43:724 [8508] cluster: PdsSectionMD5(): - OUT
May 19 12:20:43:724 [8508] cluster: PdsSectionMD5(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection(): - IN
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:724 [8508] cluster: PdsFromSection(): - OUT
May 19 12:20:43:724 [8508] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:20:43:724 [8508] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:20:43:724 [8508] cluster: PdsSectionMD5(): - OUT
May 19 12:20:43:724 [8508] cluster: PdsSectionMD5(): - IN
May 19 12:20:43:724 [8508] cluster: PdsFromSection(): - IN
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:725 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:725 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:725 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:725 [8508] cluster: PdsFromSection(): - OUT
May 19 12:20:43:725 [8508] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:20:43:725 [8508] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:20:43:725 [8508] cluster: PdsSectionMD5(): - OUT
May 19 12:20:43:725 [8508] cluster: PdsSectionMD5(): - IN
May 19 12:20:43:725 [8508] cluster: PdsFromSection(): - IN
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:725 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:725 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:725 [8508] cluster: recursive_section2pds(): - IN
May 19 12:20:43:725 [8508] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:20:43:726 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:726 [8508] cluster: recursive_section2pds(): - OUT
May 19 12:20:43:726 [8508] cluster: PdsFromSection(): - OUT
May 19 12:20:43:726 [8508] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:20:43:726 [8508] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:20:43:726 [8508] cluster: PdsSectionMD5(): - OUT
May 19 12:20:43:726 [8508] cluster: CheckConfigVersionPds(): - OUT
May 19 12:20:43:726 [8508] cluster: CheckMyResourceGroups(): - OUT
May 19 12:20:43:726 [8508] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:44:460 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:45:460 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:45:698 [8520] cluster: (Main)update node & group conf is starting in thread 10952
May 19 12:20:45:698 [8520] cluster: main - adding Sleep 10
May 19 12:20:45:698 [10952] cluster: doWork(): - IN
May 19 12:20:45:698 [10952] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:46:461 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:47:462 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:47:699 [8520] cluster: (Main)update node & group conf is starting in thread 16256
May 19 12:20:47:699 [8520] cluster: main - adding Sleep 10
May 19 12:20:47:699 [16256] cluster: doWork(): - IN
May 19 12:20:47:699 [16256] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:48:463 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:49:464 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:49:701 [8520] cluster: (Main)update node & group conf is starting in thread 21692
May 19 12:20:49:701 [8520] cluster: main - adding Sleep 10
May 19 12:20:49:701 [21692] cluster: doWork(): - IN
May 19 12:20:49:701 [21692] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:50:465 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:51:465 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:51:703 [8520] cluster: (Main)update node & group conf is starting in thread 13540
May 19 12:20:51:703 [8520] cluster: main - adding Sleep 10
May 19 12:20:51:703 [13540] cluster: doWork(): - IN
May 19 12:20:51:703 [13540] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:52:466 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:53:467 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:53:704 [8520] cluster: (Main)update node & group conf is starting in thread 19740
May 19 12:20:53:704 [8520] cluster: main - adding Sleep 10
May 19 12:20:53:704 [19740] cluster: doWork(): - IN
May 19 12:20:53:704 [19740] cluster: doWork - check groups
May 19 12:20:53:704 [19740] cluster: MapResourceGroups(): - IN
May 19 12:20:53:704 [19740] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:53:726 [19740] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:53:726 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:53:726 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:53:726 [19740] cluster: FindNode() End - OUT
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:53:726 [19740] cluster: FindGroup(): - IN
May 19 12:20:53:726 [19740] cluster: FindGroup(): - OUT
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - pds Deleted
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:20:53:726 [19740] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:53:726 [19740] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:53:726 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:53:727 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:53:727 [19740] cluster: FindNode() End - OUT
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:53:727 [19740] cluster: FindGroup(): - IN
May 19 12:20:53:727 [19740] cluster: FindGroup(): - OUT
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - pds Deleted
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:53:727 [19740] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:53:727 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:53:727 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:53:727 [19740] cluster: FindNode() End - OUT
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:53:727 [19740] cluster: FindGroup(): - IN
May 19 12:20:53:727 [19740] cluster: FindGroup(): - OUT
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - pds Deleted
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:53:727 [19740] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:53:727 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:53:727 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:53:727 [19740] cluster: FindNode() End - OUT
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:53:727 [19740] cluster: FindGroup(): - IN
May 19 12:20:53:727 [19740] cluster: FindGroup(): - OUT
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - pds Deleted
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:20:53:727 [19740] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:20:53:727 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:20:53:727 [19740] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:20:53:727 [19740] cluster: FindNode() End - OUT
May 19 12:20:53:727 [19740] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:20:53:728 [19740] cluster: FindGroup(): - IN
May 19 12:20:53:728 [19740] cluster: FindGroup(): - OUT
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - Group state set to 0
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - pds Deleted
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - Node Active set to True
May 19 12:20:53:728 [19740] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - starting
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckRestart - end
May 19 12:20:53:728 [19740] cluster: MapResourceGroups(): - OUT
May 19 12:20:53:728 [19740] cluster: doWork - check my resource groups
May 19 12:20:53:728 [19740] cluster: CheckMyResourceGroups(): - IN
May 19 12:20:53:728 [19740] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:20:53:728 [19740] cluster: CheckResourceGroup(): - IN
May 19 12:20:53:728 [19740] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:53:728 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:728 [19740] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:20:53:728 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:728 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup(): - OUT
May 19 12:20:53:729 [19740] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup(): - IN
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup(): - OUT
May 19 12:20:53:729 [19740] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup(): - IN
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:20:53:729 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:729 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:730 [19740] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:20:53:730 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:730 [19740] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:20:53:730 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:730 [19740] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:20:53:730 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:730 [19740] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:731 [19740] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:20:53:731 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:731 [19740] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:20:53:731 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:731 [19740] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:20:53:731 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:731 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:732 [19740] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:20:53:732 [19740] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource(): - IN
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:20:53:732 [19740] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:20:53:732 [19740] cluster: CheckResourceGroup(): - OUT
May 19 12:20:53:732 [19740] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:20:53:732 [19740] cluster: CheckResourceGroup(): - IN
May 19 12:20:53:732 [19740] cluster: CheckResourceGroup(): - OUT
May 19 12:20:53:732 [19740] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:20:53:732 [19740] cluster: CheckResourceGroup(): - IN
May 19 12:20:53:732 [19740] cluster: CheckResourceGroup(): - OUT
May 19 12:20:53:732 [19740] cluster: CheckConfigVersionPds(): - IN
May 19 12:20:53:732 [19740] cluster: PdsSectionMD5(): - IN
May 19 12:20:53:732 [19740] cluster: PdsFromSection(): - IN
May 19 12:20:53:732 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:733 [19740] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:20:53:733 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:733 [19740] cluster: PdsFromSection(): - OUT
May 19 12:20:53:733 [19740] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:20:53:733 [19740] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:20:53:733 [19740] cluster: PdsSectionMD5(): - OUT
May 19 12:20:53:733 [19740] cluster: PdsSectionMD5(): - IN
May 19 12:20:53:733 [19740] cluster: PdsFromSection(): - IN
May 19 12:20:53:733 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:733 [19740] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:20:53:733 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:733 [19740] cluster: PdsFromSection(): - OUT
May 19 12:20:53:733 [19740] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:20:53:733 [19740] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:20:53:733 [19740] cluster: PdsSectionMD5(): - OUT
May 19 12:20:53:733 [19740] cluster: PdsSectionMD5(): - IN
May 19 12:20:53:733 [19740] cluster: PdsFromSection(): - IN
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:734 [19740] cluster: PdsFromSection(): - OUT
May 19 12:20:53:734 [19740] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:20:53:734 [19740] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:20:53:734 [19740] cluster: PdsSectionMD5(): - OUT
May 19 12:20:53:734 [19740] cluster: PdsSectionMD5(): - IN
May 19 12:20:53:734 [19740] cluster: PdsFromSection(): - IN
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:735 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:735 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:735 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:735 [19740] cluster: PdsFromSection(): - OUT
May 19 12:20:53:735 [19740] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:20:53:735 [19740] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:20:53:735 [19740] cluster: PdsSectionMD5(): - OUT
May 19 12:20:53:735 [19740] cluster: PdsSectionMD5(): - IN
May 19 12:20:53:735 [19740] cluster: PdsFromSection(): - IN
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:735 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:735 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - IN
May 19 12:20:53:735 [19740] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:735 [19740] cluster: recursive_section2pds(): - OUT
May 19 12:20:53:735 [19740] cluster: PdsFromSection(): - OUT
May 19 12:20:53:735 [19740] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:20:53:735 [19740] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:20:53:735 [19740] cluster: PdsSectionMD5(): - OUT
May 19 12:20:53:735 [19740] cluster: CheckConfigVersionPds(): - OUT
May 19 12:20:53:735 [19740] cluster: CheckMyResourceGroups(): - OUT
May 19 12:20:53:735 [19740] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:54:468 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:55:469 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:55:706 [8520] cluster: (Main)update node & group conf is starting in thread 21752
May 19 12:20:55:706 [8520] cluster: main - adding Sleep 10
May 19 12:20:55:706 [21752] cluster: doWork(): - IN
May 19 12:20:55:706 [21752] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:56:470 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:57:470 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:57:708 [8520] cluster: (Main)update node & group conf is starting in thread 14516
May 19 12:20:57:708 [8520] cluster: main - adding Sleep 10
May 19 12:20:57:708 [14516] cluster: doWork(): - IN
May 19 12:20:57:708 [14516] cluster: node_state_resgroup_thread(): - OUT
May 19 12:20:58:471 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:59:457 [4548] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:20:59:457 [4548] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:20:59:457 [4548] cluster: (updateGroupConf) - Finished!
May 19 12:20:59:457 [4548] cluster: updateGroupConf(): - OUT
May 19 12:20:59:457 [4548] cluster:  (update_node_group_conf_thread) Releasing gRestartCallbackLock 
May 19 12:20:59:472 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:20:59:709 [8520] cluster: (Main)update node & group conf is starting in thread 13240
May 19 12:20:59:709 [8520] cluster: main - adding Sleep 10
May 19 12:20:59:709 [13240] cluster: doWork(): - IN
May 19 12:20:59:709 [13240] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:00:473 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:01:474 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:01:711 [8520] cluster: (Main)update node & group conf is starting in thread 11404
May 19 12:21:01:711 [8520] cluster: main - adding Sleep 10
May 19 12:21:01:711 [11404] cluster: doWork(): - IN
May 19 12:21:01:711 [11404] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:02:475 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:03:476 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:03:713 [8520] cluster: (Main)update node & group conf is starting in thread 14780
May 19 12:21:03:713 [8520] cluster: main - adding Sleep 10
May 19 12:21:03:713 [14780] cluster: doWork(): - IN
May 19 12:21:03:713 [14780] cluster: doWork - check groups
May 19 12:21:03:713 [14780] cluster: MapResourceGroups(): - IN
May 19 12:21:03:713 [14780] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:03:734 [14780] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:03:734 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:03:734 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:03:734 [14780] cluster: FindNode() End - OUT
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:03:734 [14780] cluster: FindGroup(): - IN
May 19 12:21:03:734 [14780] cluster: FindGroup(): - OUT
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - pds Deleted
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:03:734 [14780] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:03:734 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:03:734 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:03:734 [14780] cluster: FindNode() End - OUT
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:03:734 [14780] cluster: FindGroup(): - IN
May 19 12:21:03:734 [14780] cluster: FindGroup(): - OUT
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - pds Deleted
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:03:734 [14780] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:03:734 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:03:734 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:03:734 [14780] cluster: FindNode() End - OUT
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:03:734 [14780] cluster: FindGroup(): - IN
May 19 12:21:03:734 [14780] cluster: FindGroup(): - OUT
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - pds Deleted
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:21:03:734 [14780] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:03:734 [14780] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:03:734 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:03:735 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:03:735 [14780] cluster: FindNode() End - OUT
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:03:735 [14780] cluster: FindGroup(): - IN
May 19 12:21:03:735 [14780] cluster: FindGroup(): - OUT
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - pds Deleted
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:03:735 [14780] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:03:735 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:03:735 [14780] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:03:735 [14780] cluster: FindNode() End - OUT
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:03:735 [14780] cluster: FindGroup(): - IN
May 19 12:21:03:735 [14780] cluster: FindGroup(): - OUT
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - pds Deleted
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Node Active set to True
May 19 12:21:03:735 [14780] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - starting
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckRestart - end
May 19 12:21:03:735 [14780] cluster: MapResourceGroups(): - OUT
May 19 12:21:03:735 [14780] cluster: doWork - check my resource groups
May 19 12:21:03:735 [14780] cluster: CheckMyResourceGroups(): - IN
May 19 12:21:03:735 [14780] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:21:03:735 [14780] cluster: CheckResourceGroup(): - IN
May 19 12:21:03:735 [14780] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:03:735 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:735 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup(): - OUT
May 19 12:21:03:736 [14780] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup(): - IN
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:21:03:736 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:21:03:736 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup(): - OUT
May 19 12:21:03:737 [14780] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup(): - IN
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:21:03:737 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:21:03:737 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:738 [14780] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:21:03:738 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:738 [14780] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:21:03:738 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:738 [14780] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:21:03:738 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:738 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:738 [14780] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:03:739 [14780] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup(): - OUT
May 19 12:21:03:739 [14780] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup(): - IN
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup(): - OUT
May 19 12:21:03:739 [14780] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup(): - IN
May 19 12:21:03:739 [14780] cluster: CheckResourceGroup(): - OUT
May 19 12:21:03:739 [14780] cluster: CheckConfigVersionPds(): - IN
May 19 12:21:03:739 [14780] cluster: PdsSectionMD5(): - IN
May 19 12:21:03:739 [14780] cluster: PdsFromSection(): - IN
May 19 12:21:03:740 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:740 [14780] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:21:03:740 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:740 [14780] cluster: PdsFromSection(): - OUT
May 19 12:21:03:740 [14780] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:21:03:740 [14780] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:21:03:740 [14780] cluster: PdsSectionMD5(): - OUT
May 19 12:21:03:740 [14780] cluster: PdsSectionMD5(): - IN
May 19 12:21:03:740 [14780] cluster: PdsFromSection(): - IN
May 19 12:21:03:740 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:740 [14780] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:21:03:740 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:740 [14780] cluster: PdsFromSection(): - OUT
May 19 12:21:03:740 [14780] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:21:03:740 [14780] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:21:03:740 [14780] cluster: PdsSectionMD5(): - OUT
May 19 12:21:03:740 [14780] cluster: PdsSectionMD5(): - IN
May 19 12:21:03:740 [14780] cluster: PdsFromSection(): - IN
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:741 [14780] cluster: PdsFromSection(): - OUT
May 19 12:21:03:741 [14780] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:21:03:741 [14780] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:21:03:741 [14780] cluster: PdsSectionMD5(): - OUT
May 19 12:21:03:741 [14780] cluster: PdsSectionMD5(): - IN
May 19 12:21:03:741 [14780] cluster: PdsFromSection(): - IN
May 19 12:21:03:742 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:742 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:21:03:742 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:742 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:21:03:742 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:742 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:742 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:21:03:742 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:742 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:742 [14780] cluster: PdsFromSection(): - OUT
May 19 12:21:03:742 [14780] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:21:03:742 [14780] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:21:03:742 [14780] cluster: PdsSectionMD5(): - OUT
May 19 12:21:03:742 [14780] cluster: PdsSectionMD5(): - IN
May 19 12:21:03:742 [14780] cluster: PdsFromSection(): - IN
May 19 12:21:03:742 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:742 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:21:03:743 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:743 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:21:03:743 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:743 [14780] cluster: recursive_section2pds(): - IN
May 19 12:21:03:743 [14780] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:21:03:743 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:743 [14780] cluster: recursive_section2pds(): - OUT
May 19 12:21:03:743 [14780] cluster: PdsFromSection(): - OUT
May 19 12:21:03:743 [14780] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:21:03:743 [14780] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:21:03:743 [14780] cluster: PdsSectionMD5(): - OUT
May 19 12:21:03:743 [14780] cluster: CheckConfigVersionPds(): - OUT
May 19 12:21:03:743 [14780] cluster: CheckMyResourceGroups(): - OUT
May 19 12:21:03:743 [14780] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:04:476 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:05:477 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:05:714 [8520] cluster: (Main)update node & group conf is starting in thread 14636
May 19 12:21:05:714 [8520] cluster: main - adding Sleep 10
May 19 12:21:05:714 [14636] cluster: doWork(): - IN
May 19 12:21:05:714 [14636] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:06:478 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:07:479 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:07:716 [8520] cluster: (Main)update node & group conf is starting in thread 22148
May 19 12:21:07:716 [8520] cluster: main - adding Sleep 10
May 19 12:21:07:716 [22148] cluster: doWork(): - IN
May 19 12:21:07:716 [22148] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:08:480 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:09:481 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:09:718 [8520] cluster: (Main)update node & group conf is starting in thread 22416
May 19 12:21:09:718 [8520] cluster: main - adding Sleep 10
May 19 12:21:09:718 [22416] cluster: doWork(): - IN
May 19 12:21:09:718 [22416] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:10:481 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:11:482 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:11:719 [8520] cluster: (Main)update node & group conf is starting in thread 3516
May 19 12:21:11:719 [8520] cluster: main - adding Sleep 10
May 19 12:21:11:719 [3516] cluster: doWork(): - IN
May 19 12:21:11:719 [3516] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:12:483 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:13:484 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:13:721 [8520] cluster: (Main)update node & group conf is starting in thread 7704
May 19 12:21:13:721 [8520] cluster: main - adding Sleep 10
May 19 12:21:13:721 [7704] cluster: doWork(): - IN
May 19 12:21:13:721 [7704] cluster: doWork - check groups
May 19 12:21:13:721 [7704] cluster: MapResourceGroups(): - IN
May 19 12:21:13:721 [7704] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:13:742 [7704] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:13:742 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:13:742 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:13:742 [7704] cluster: FindNode() End - OUT
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:13:742 [7704] cluster: FindGroup(): - IN
May 19 12:21:13:742 [7704] cluster: FindGroup(): - OUT
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - pds Deleted
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:13:742 [7704] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:13:743 [7704] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:13:743 [7704] cluster: FindNode() End - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:13:743 [7704] cluster: FindGroup(): - IN
May 19 12:21:13:743 [7704] cluster: FindGroup(): - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - pds Deleted
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:13:743 [7704] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:13:743 [7704] cluster: FindNode() End - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:13:743 [7704] cluster: FindGroup(): - IN
May 19 12:21:13:743 [7704] cluster: FindGroup(): - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - pds Deleted
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:13:743 [7704] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:13:743 [7704] cluster: FindNode() End - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:13:743 [7704] cluster: FindGroup(): - IN
May 19 12:21:13:743 [7704] cluster: FindGroup(): - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - pds Deleted
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:13:743 [7704] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:13:743 [7704] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:13:743 [7704] cluster: FindNode() End - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:13:743 [7704] cluster: FindGroup(): - IN
May 19 12:21:13:743 [7704] cluster: FindGroup(): - OUT
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - pds Deleted
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Node Active set to True
May 19 12:21:13:743 [7704] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:21:13:743 [7704] cluster: ProbeInfoCheckRestart - starting
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckRestart - end
May 19 12:21:13:744 [7704] cluster: MapResourceGroups(): - OUT
May 19 12:21:13:744 [7704] cluster: doWork - check my resource groups
May 19 12:21:13:744 [7704] cluster: CheckMyResourceGroups(): - IN
May 19 12:21:13:744 [7704] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:21:13:744 [7704] cluster: CheckResourceGroup(): - IN
May 19 12:21:13:744 [7704] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:13:744 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:744 [7704] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:21:13:744 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:744 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup(): - OUT
May 19 12:21:13:745 [7704] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup(): - IN
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup(): - OUT
May 19 12:21:13:745 [7704] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup(): - IN
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:13:745 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:745 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:746 [7704] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:21:13:746 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:746 [7704] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:21:13:746 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:746 [7704] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:21:13:746 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:746 [7704] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:747 [7704] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:21:13:747 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:747 [7704] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:21:13:747 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:747 [7704] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:21:13:747 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:747 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:748 [7704] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:21:13:748 [7704] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:13:748 [7704] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:13:748 [7704] cluster: CheckResourceGroup(): - OUT
May 19 12:21:13:748 [7704] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:21:13:748 [7704] cluster: CheckResourceGroup(): - IN
May 19 12:21:13:748 [7704] cluster: CheckResourceGroup(): - OUT
May 19 12:21:13:748 [7704] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:21:13:748 [7704] cluster: CheckResourceGroup(): - IN
May 19 12:21:13:748 [7704] cluster: CheckResourceGroup(): - OUT
May 19 12:21:13:748 [7704] cluster: CheckConfigVersionPds(): - IN
May 19 12:21:13:748 [7704] cluster: PdsSectionMD5(): - IN
May 19 12:21:13:748 [7704] cluster: PdsFromSection(): - IN
May 19 12:21:13:749 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:749 [7704] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:21:13:749 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:749 [7704] cluster: PdsFromSection(): - OUT
May 19 12:21:13:749 [7704] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:21:13:749 [7704] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:21:13:749 [7704] cluster: PdsSectionMD5(): - OUT
May 19 12:21:13:749 [7704] cluster: PdsSectionMD5(): - IN
May 19 12:21:13:749 [7704] cluster: PdsFromSection(): - IN
May 19 12:21:13:749 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:749 [7704] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:21:13:749 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:749 [7704] cluster: PdsFromSection(): - OUT
May 19 12:21:13:749 [7704] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:21:13:749 [7704] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:21:13:749 [7704] cluster: PdsSectionMD5(): - OUT
May 19 12:21:13:749 [7704] cluster: PdsSectionMD5(): - IN
May 19 12:21:13:749 [7704] cluster: PdsFromSection(): - IN
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:750 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:750 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:751 [7704] cluster: PdsFromSection(): - OUT
May 19 12:21:13:751 [7704] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:21:13:751 [7704] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:21:13:751 [7704] cluster: PdsSectionMD5(): - OUT
May 19 12:21:13:751 [7704] cluster: PdsSectionMD5(): - IN
May 19 12:21:13:751 [7704] cluster: PdsFromSection(): - IN
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:751 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:751 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:751 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:751 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:751 [7704] cluster: PdsFromSection(): - OUT
May 19 12:21:13:751 [7704] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:21:13:751 [7704] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:21:13:751 [7704] cluster: PdsSectionMD5(): - OUT
May 19 12:21:13:751 [7704] cluster: PdsSectionMD5(): - IN
May 19 12:21:13:751 [7704] cluster: PdsFromSection(): - IN
May 19 12:21:13:752 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:752 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:21:13:752 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:752 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:21:13:752 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:752 [7704] cluster: recursive_section2pds(): - IN
May 19 12:21:13:752 [7704] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:21:13:752 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:752 [7704] cluster: recursive_section2pds(): - OUT
May 19 12:21:13:752 [7704] cluster: PdsFromSection(): - OUT
May 19 12:21:13:752 [7704] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:21:13:752 [7704] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:21:13:752 [7704] cluster: PdsSectionMD5(): - OUT
May 19 12:21:13:752 [7704] cluster: CheckConfigVersionPds(): - OUT
May 19 12:21:13:752 [7704] cluster: CheckMyResourceGroups(): - OUT
May 19 12:21:13:752 [7704] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:14:485 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:15:486 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:15:723 [8520] cluster: (Main)update node & group conf is starting in thread 19004
May 19 12:21:15:723 [8520] cluster: main - adding Sleep 10
May 19 12:21:15:723 [19004] cluster: doWork(): - IN
May 19 12:21:15:723 [19004] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:16:486 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:17:487 [20420] cluster: update node & group conf is starting in thread 16928
May 19 12:21:17:487 [16928] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:21:17:487 [16928] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:21:17:487 [16928] cluster: child udp_thread
May 19 12:21:17:487 [16928] cluster: child udp - Update node configs
May 19 12:21:17:487 [16928] cluster: updateNodeConf(): - IN
May 19 12:21:17:487 [16928] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:21:17:487 [16928] cluster: NodeConfigurationRequest(): - IN
May 19 12:21:17:487 [16928] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:21:17:487 [16928] cluster: PdsFromSection(): - IN
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster size=74
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - IN
May 19 12:21:17:488 [16928] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: recursive_section2pds(): - OUT
May 19 12:21:17:488 [16928] cluster: PdsFromSection(): - OUT
May 19 12:21:17:488 [16928] cluster: NodeConfigurationRequest(): - OUT
May 19 12:21:17:488 [16928] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:21:17:725 [8520] cluster: (Main)update node & group conf is starting in thread 17608
May 19 12:21:17:725 [8520] cluster: main - adding Sleep 10
May 19 12:21:17:725 [17608] cluster: doWork(): - IN
May 19 12:21:17:725 [17608] cluster: doWork - check nodes - do connection
May 19 12:21:17:725 [17608] cluster: ConnectAllNodes(): - IN
May 19 12:21:17:725 [17608] cluster: (ConnectAllNodes) - Start
May 19 12:21:17:725 [17608] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:21:17:725 [17608] cluster: ConnectToNode(): - IN
May 19 12:21:17:725 [17608] cluster: controller port is 48000
May 19 12:21:18:466 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:18:467 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56564  h=298 d=1417
May 19 12:21:18:467 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:21:18:467 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:21:18:467 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:21:18:467 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:21:18:467 [20420] cluster: set_node_version - from 10.27.163.134/56564 [0xb78140]
May 19 12:21:18:467 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:21:18:467 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:21:18:467 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56564
May 19 12:21:18:467 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:21:18:467 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:21:18:467 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:21:18:467 [20420] cluster: RREQUEST: _close <-10.27.163.134/56564  h=287 d=0
May 19 12:21:18:467 [20420] cluster: sockClose:0000000000B78140:10.27.163.135/48003
May 19 12:21:18:468 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56565  h=299 d=866
May 19 12:21:18:468 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:21:18:468 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:21:18:468 [20420] cluster: set_group_version - from 10.27.163.134/56565 [0xb78140]
May 19 12:21:18:468 [20420] cluster: set_group_version - pds received, size=866
May 19 12:21:18:468 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:21:18:468 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:21:18:468 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:21:18:468 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:21:18:468 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:21:18:468 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:21:18:468 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:21:18:468 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:21:18:468 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:21:18:468 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:21:18:468 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:21:18:468 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:21:18:468 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56565
May 19 12:21:18:468 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:21:18:468 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:21:18:468 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:21:18:469 [20420] cluster: RREQUEST: _close <-10.27.163.134/56565  h=287 d=0
May 19 12:21:18:469 [20420] cluster: sockClose:0000000000B78140:10.27.163.135/48003
May 19 12:21:19:470 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:19:726 [8520] cluster: main - adding Sleep 10
May 19 12:21:20:471 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:21:472 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:21:728 [8520] cluster: main - adding Sleep 10
May 19 12:21:22:473 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:22:725 [17608] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:21:22:725 [17608] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:21:22:725 [17608] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:21:22:725 [17608] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:21:22:725 [17608] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:21:22:725 [17608] cluster: ConnectAllNodes(): - OUT
May 19 12:21:22:725 [17608] cluster: Not connected to any nodes!
May 19 12:21:22:725 [17608] cluster: doWork - check nodes - state
May 19 12:21:22:725 [17608] cluster: CheckNodeState(): - Starting IN
May 19 12:21:22:732 [17608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:22:732 [17608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:22:732 [17608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:22:732 [17608] cluster: FindNode() End - OUT
May 19 12:21:22:732 [17608] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:21:22:732 [17608] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:21:22:732 [17608] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:22:732 [17608] cluster: FindNode() End - OUT
May 19 12:21:22:732 [17608] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:21:22:732 [17608] cluster: CheckNodeState(): - OUT
May 19 12:21:22:732 [17608] cluster: doWork - check nodes - any new probes installed
May 19 12:21:22:732 [17608] cluster: ProbeInfoCheck(): - IN
May 19 12:21:22:732 [17608] cluster: ProbeInfoCheck(): - OUT
May 19 12:21:22:732 [17608] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:23:473 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:23:730 [8520] cluster: (Main)update node & group conf is starting in thread 9140
May 19 12:21:23:730 [8520] cluster: main - adding Sleep 10
May 19 12:21:23:730 [9140] cluster: doWork(): - IN
May 19 12:21:23:730 [9140] cluster: doWork - check groups
May 19 12:21:23:730 [9140] cluster: MapResourceGroups(): - IN
May 19 12:21:23:730 [9140] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:23:766 [9140] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:23:766 [9140] cluster: FindNode() End - OUT
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:23:766 [9140] cluster: FindGroup(): - IN
May 19 12:21:23:766 [9140] cluster: FindGroup(): - OUT
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - pds Deleted
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:23:766 [9140] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:23:766 [9140] cluster: FindNode() End - OUT
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:23:766 [9140] cluster: FindGroup(): - IN
May 19 12:21:23:766 [9140] cluster: FindGroup(): - OUT
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - pds Deleted
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:23:766 [9140] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:23:766 [9140] cluster: FindNode() End - OUT
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:23:766 [9140] cluster: FindGroup(): - IN
May 19 12:21:23:766 [9140] cluster: FindGroup(): - OUT
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - pds Deleted
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:21:23:766 [9140] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:23:766 [9140] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:23:766 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:23:767 [9140] cluster: FindNode() End - OUT
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:23:767 [9140] cluster: FindGroup(): - IN
May 19 12:21:23:767 [9140] cluster: FindGroup(): - OUT
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - pds Deleted
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:23:767 [9140] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:23:767 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:23:767 [9140] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:23:767 [9140] cluster: FindNode() End - OUT
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:23:767 [9140] cluster: FindGroup(): - IN
May 19 12:21:23:767 [9140] cluster: FindGroup(): - OUT
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - pds Deleted
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Node Active set to True
May 19 12:21:23:767 [9140] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - starting
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckRestart - end
May 19 12:21:23:767 [9140] cluster: MapResourceGroups(): - OUT
May 19 12:21:23:767 [9140] cluster: doWork - check my resource groups
May 19 12:21:23:767 [9140] cluster: CheckMyResourceGroups(): - IN
May 19 12:21:23:767 [9140] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:21:23:767 [9140] cluster: CheckResourceGroup(): - IN
May 19 12:21:23:767 [9140] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:23:767 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:767 [9140] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:21:23:767 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:23:767 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup(): - OUT
May 19 12:21:23:768 [9140] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup(): - IN
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup(): - OUT
May 19 12:21:23:768 [9140] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup(): - IN
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:23:768 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:768 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:769 [9140] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:21:23:769 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:769 [9140] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:21:23:769 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:769 [9140] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:21:23:769 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:21:23:769 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:21:23:770 [9140] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:23:770 [9140] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:23:771 [9140] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:23:771 [9140] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:21:23:771 [9140] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:771 [9140] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:23:771 [9140] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:23:771 [9140] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:23:771 [9140] cluster: CheckResourceGroup(): - OUT
May 19 12:21:23:771 [9140] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:21:23:771 [9140] cluster: CheckResourceGroup(): - IN
May 19 12:21:23:771 [9140] cluster: CheckResourceGroup(): - OUT
May 19 12:21:23:771 [9140] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:21:23:771 [9140] cluster: CheckResourceGroup(): - IN
May 19 12:21:23:771 [9140] cluster: CheckResourceGroup(): - OUT
May 19 12:21:23:771 [9140] cluster: CheckConfigVersionPds(): - IN
May 19 12:21:23:771 [9140] cluster: PdsSectionMD5(): - IN
May 19 12:21:23:771 [9140] cluster: PdsFromSection(): - IN
May 19 12:21:23:771 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:771 [9140] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:21:23:771 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:771 [9140] cluster: PdsFromSection(): - OUT
May 19 12:21:23:771 [9140] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:21:23:771 [9140] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:21:23:771 [9140] cluster: PdsSectionMD5(): - OUT
May 19 12:21:23:771 [9140] cluster: PdsSectionMD5(): - IN
May 19 12:21:23:771 [9140] cluster: PdsFromSection(): - IN
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:772 [9140] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:772 [9140] cluster: PdsFromSection(): - OUT
May 19 12:21:23:772 [9140] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:21:23:772 [9140] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:21:23:772 [9140] cluster: PdsSectionMD5(): - OUT
May 19 12:21:23:772 [9140] cluster: PdsSectionMD5(): - IN
May 19 12:21:23:772 [9140] cluster: PdsFromSection(): - IN
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:772 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:772 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:772 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:772 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:772 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: PdsFromSection(): - OUT
May 19 12:21:23:773 [9140] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:21:23:773 [9140] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:21:23:773 [9140] cluster: PdsSectionMD5(): - OUT
May 19 12:21:23:773 [9140] cluster: PdsSectionMD5(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection(): - IN
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:773 [9140] cluster: PdsFromSection(): - OUT
May 19 12:21:23:773 [9140] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:21:23:773 [9140] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:21:23:773 [9140] cluster: PdsSectionMD5(): - OUT
May 19 12:21:23:773 [9140] cluster: PdsSectionMD5(): - IN
May 19 12:21:23:773 [9140] cluster: PdsFromSection(): - IN
May 19 12:21:23:774 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:774 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:21:23:774 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:774 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:21:23:774 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:774 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:21:23:774 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:774 [9140] cluster: recursive_section2pds(): - IN
May 19 12:21:23:774 [9140] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:21:23:774 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:774 [9140] cluster: recursive_section2pds(): - OUT
May 19 12:21:23:774 [9140] cluster: PdsFromSection(): - OUT
May 19 12:21:23:774 [9140] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:21:23:774 [9140] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:21:23:774 [9140] cluster: PdsSectionMD5(): - OUT
May 19 12:21:23:774 [9140] cluster: CheckConfigVersionPds(): - OUT
May 19 12:21:23:774 [9140] cluster: CheckMyResourceGroups(): - OUT
May 19 12:21:23:774 [9140] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:24:474 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:25:475 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:25:731 [8520] cluster: (Main)update node & group conf is starting in thread 10632
May 19 12:21:25:731 [8520] cluster: main - adding Sleep 10
May 19 12:21:25:731 [10632] cluster: doWork(): - IN
May 19 12:21:25:731 [10632] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:26:476 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:27:477 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:27:733 [8520] cluster: (Main)update node & group conf is starting in thread 20904
May 19 12:21:27:733 [8520] cluster: main - adding Sleep 10
May 19 12:21:27:733 [20904] cluster: doWork(): - IN
May 19 12:21:27:733 [20904] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:28:478 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:29:478 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:29:735 [8520] cluster: (Main)update node & group conf is starting in thread 19232
May 19 12:21:29:735 [8520] cluster: main - adding Sleep 10
May 19 12:21:29:735 [19232] cluster: doWork(): - IN
May 19 12:21:29:735 [19232] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:30:479 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:30:707 [8520] cluster: RREQUEST: set_node_up <-10.27.163.134/56568  h=293 d=106
May 19 12:21:30:707 [8520] cluster: nimSockaddr2Ip - found 10.27.163.134
May 19 12:21:30:708 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:21:30:711 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:21:30:711 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:21:30:711 [8520] cluster:  data   time=1589883690 access=2 ident=30960
May 19 12:21:30:711 [8520] cluster: sockClose:0000000000B584A0:10.27.163.135/56263
May 19 12:21:30:711 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:21:30:711 [8520] cluster: cmd_set_node_up(): - IN
May 19 12:21:30:711 [8520] cluster: set_node_up - from 10.27.163.134/56568 [0xb56fe0]
May 19 12:21:30:711 [8520] cluster: cmd_set_node_up(): - OUT
May 19 12:21:30:711 [7764] cluster: thrSetNodeUp(): - IN
May 19 12:21:30:711 [7764] cluster:  (thrSetNodeUp) Waiting gthreadCallbackLock 
May 19 12:21:30:711 [7764] cluster:  (thrSetNodeUp) Locking gthreadCallbackLock 
May 19 12:21:30:711 [7764] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:21:30:711 [7764] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:30:711 [7764] cluster: FindNode() End - OUT
May 19 12:21:30:711 [7764] cluster: thrSetNodeUp - Caller address: /TotalDxim/SDCPPDXIM07/frhdstd-apbct01/cluster, My adress: 10.27.163.135
May 19 12:21:30:711 [7764] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56568
May 19 12:21:30:711 [7764] cluster:  head   mtype=200 status=0 seq=0
May 19 12:21:30:711 [7764] cluster: sockClose:0000000000B56FE0:10.27.163.135/48008
May 19 12:21:30:712 [7764] cluster: SREQUEST: _close ->10.27.163.134/56568
May 19 12:21:30:712 [7764] cluster:  (thrSetNodeUp) Releasing gthreadCallbackLock 
May 19 12:21:30:712 [7764] cluster: thrSetNodeUp(): - OUT
May 19 12:21:31:480 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:31:712 [8520] cluster: (Main)update node & group conf is starting in thread 14748
May 19 12:21:31:712 [8520] cluster: main - adding Sleep 10
May 19 12:21:31:712 [14748] cluster: doWork(): - IN
May 19 12:21:31:712 [14748] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:32:481 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:33:482 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:33:714 [8520] cluster: (Main)update node & group conf is starting in thread 13256
May 19 12:21:33:714 [8520] cluster: main - adding Sleep 10
May 19 12:21:33:714 [13256] cluster: doWork(): - IN
May 19 12:21:33:714 [13256] cluster: doWork - check groups
May 19 12:21:33:714 [13256] cluster: MapResourceGroups(): - IN
May 19 12:21:33:714 [13256] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:33:735 [13256] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:33:735 [13256] cluster: FindNode() End - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:33:735 [13256] cluster: FindGroup(): - IN
May 19 12:21:33:735 [13256] cluster: FindGroup(): - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - pds Deleted
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:33:735 [13256] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:33:735 [13256] cluster: FindNode() End - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:33:735 [13256] cluster: FindGroup(): - IN
May 19 12:21:33:735 [13256] cluster: FindGroup(): - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - pds Deleted
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:33:735 [13256] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:33:735 [13256] cluster: FindNode() End - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:33:735 [13256] cluster: FindGroup(): - IN
May 19 12:21:33:735 [13256] cluster: FindGroup(): - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - pds Deleted
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:33:735 [13256] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:33:735 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:33:735 [13256] cluster: FindNode() End - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:33:735 [13256] cluster: FindGroup(): - IN
May 19 12:21:33:735 [13256] cluster: FindGroup(): - OUT
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:21:33:735 [13256] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - pds Deleted
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:33:736 [13256] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:33:736 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:33:736 [13256] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:33:736 [13256] cluster: FindNode() End - OUT
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:33:736 [13256] cluster: FindGroup(): - IN
May 19 12:21:33:736 [13256] cluster: FindGroup(): - OUT
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - pds Deleted
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Node Active set to True
May 19 12:21:33:736 [13256] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - starting
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckRestart - end
May 19 12:21:33:736 [13256] cluster: MapResourceGroups(): - OUT
May 19 12:21:33:736 [13256] cluster: doWork - check my resource groups
May 19 12:21:33:736 [13256] cluster: CheckMyResourceGroups(): - IN
May 19 12:21:33:736 [13256] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:21:33:736 [13256] cluster: CheckResourceGroup(): - IN
May 19 12:21:33:736 [13256] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:33:736 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:736 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:736 [13256] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:21:33:737 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:737 [13256] cluster: CheckResourceGroup(): - OUT
May 19 12:21:33:737 [13256] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:21:33:737 [13256] cluster: CheckResourceGroup(): - IN
May 19 12:21:33:737 [13256] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:33:737 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:737 [13256] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:21:33:737 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:737 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup(): - OUT
May 19 12:21:33:738 [13256] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup(): - IN
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:21:33:738 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:33:738 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:739 [13256] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:21:33:739 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:739 [13256] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:21:33:739 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:739 [13256] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:21:33:739 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:739 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:33:740 [13256] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup(): - OUT
May 19 12:21:33:740 [13256] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup(): - IN
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup(): - OUT
May 19 12:21:33:740 [13256] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup(): - IN
May 19 12:21:33:740 [13256] cluster: CheckResourceGroup(): - OUT
May 19 12:21:33:740 [13256] cluster: CheckConfigVersionPds(): - IN
May 19 12:21:33:740 [13256] cluster: PdsSectionMD5(): - IN
May 19 12:21:33:740 [13256] cluster: PdsFromSection(): - IN
May 19 12:21:33:741 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:741 [13256] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:21:33:741 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:741 [13256] cluster: PdsFromSection(): - OUT
May 19 12:21:33:741 [13256] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:21:33:741 [13256] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:21:33:741 [13256] cluster: PdsSectionMD5(): - OUT
May 19 12:21:33:741 [13256] cluster: PdsSectionMD5(): - IN
May 19 12:21:33:741 [13256] cluster: PdsFromSection(): - IN
May 19 12:21:33:741 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:741 [13256] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:21:33:741 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:741 [13256] cluster: PdsFromSection(): - OUT
May 19 12:21:33:741 [13256] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:21:33:741 [13256] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:21:33:741 [13256] cluster: PdsSectionMD5(): - OUT
May 19 12:21:33:741 [13256] cluster: PdsSectionMD5(): - IN
May 19 12:21:33:741 [13256] cluster: PdsFromSection(): - IN
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:742 [13256] cluster: PdsFromSection(): - OUT
May 19 12:21:33:742 [13256] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:21:33:742 [13256] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:21:33:742 [13256] cluster: PdsSectionMD5(): - OUT
May 19 12:21:33:742 [13256] cluster: PdsSectionMD5(): - IN
May 19 12:21:33:742 [13256] cluster: PdsFromSection(): - IN
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:743 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:743 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:743 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:743 [13256] cluster: PdsFromSection(): - OUT
May 19 12:21:33:743 [13256] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:21:33:743 [13256] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:21:33:743 [13256] cluster: PdsSectionMD5(): - OUT
May 19 12:21:33:743 [13256] cluster: PdsSectionMD5(): - IN
May 19 12:21:33:743 [13256] cluster: PdsFromSection(): - IN
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:743 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:743 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:21:33:743 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:744 [13256] cluster: recursive_section2pds(): - IN
May 19 12:21:33:744 [13256] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:21:33:744 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:744 [13256] cluster: recursive_section2pds(): - OUT
May 19 12:21:33:744 [13256] cluster: PdsFromSection(): - OUT
May 19 12:21:33:744 [13256] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:21:33:744 [13256] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:21:33:744 [13256] cluster: PdsSectionMD5(): - OUT
May 19 12:21:33:744 [13256] cluster: CheckConfigVersionPds(): - OUT
May 19 12:21:33:744 [13256] cluster: CheckMyResourceGroups(): - OUT
May 19 12:21:33:744 [13256] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:34:483 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:35:483 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:35:716 [8520] cluster: (Main)update node & group conf is starting in thread 12380
May 19 12:21:35:716 [8520] cluster: main - adding Sleep 10
May 19 12:21:35:716 [12380] cluster: doWork(): - IN
May 19 12:21:35:716 [12380] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:36:484 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:37:485 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:37:717 [8520] cluster: (Main)update node & group conf is starting in thread 18292
May 19 12:21:37:717 [8520] cluster: main - adding Sleep 10
May 19 12:21:37:717 [18292] cluster: doWork(): - IN
May 19 12:21:37:717 [18292] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:38:486 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:38:488 [16928] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:21:38:488 [16928] cluster: (updateNodeConf) - Connect to ip/host: 10.30.10.16
May 19 12:21:38:488 [16928] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:21:38:488 [16928] cluster: updateNodeConf(): - OUT
May 19 12:21:38:488 [16928] cluster: child udp - Update group configs
May 19 12:21:38:488 [16928] cluster: updateGroupConf(): - IN
May 19 12:21:38:488 [16928] cluster: (updateGroupConf) - This node ip/host: 10.27.163.135
May 19 12:21:38:488 [16928] cluster: ResourceGroupConfigurationRequest(): - IN
May 19 12:21:38:488 [16928] cluster: ResourceGroupConfigurationRequest(): - OUT
May 19 12:21:38:488 [16928] cluster: (updateGroupConf) - Connect to ip/host: 10.30.10.16, port: 48003
May 19 12:21:39:487 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:39:719 [8520] cluster: (Main)update node & group conf is starting in thread 7180
May 19 12:21:39:719 [8520] cluster: main - adding Sleep 10
May 19 12:21:39:719 [7180] cluster: doWork(): - IN
May 19 12:21:39:719 [7180] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:40:488 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:41:489 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:41:721 [8520] cluster: (Main)update node & group conf is starting in thread 21220
May 19 12:21:41:721 [8520] cluster: main - adding Sleep 10
May 19 12:21:41:721 [21220] cluster: doWork(): - IN
May 19 12:21:41:721 [21220] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:42:489 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:43:490 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:43:722 [8520] cluster: (Main)update node & group conf is starting in thread 9364
May 19 12:21:43:722 [8520] cluster: main - adding Sleep 10
May 19 12:21:43:722 [9364] cluster: doWork(): - IN
May 19 12:21:43:722 [9364] cluster: doWork - check groups
May 19 12:21:43:722 [9364] cluster: MapResourceGroups(): - IN
May 19 12:21:43:722 [9364] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:43:743 [9364] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:43:743 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:43:743 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:43:743 [9364] cluster: FindNode() End - OUT
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:43:743 [9364] cluster: FindGroup(): - IN
May 19 12:21:43:743 [9364] cluster: FindGroup(): - OUT
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - pds Deleted
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:43:743 [9364] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:43:743 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:43:743 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:43:743 [9364] cluster: FindNode() End - OUT
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:43:743 [9364] cluster: FindGroup(): - IN
May 19 12:21:43:743 [9364] cluster: FindGroup(): - OUT
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - pds Deleted
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:43:743 [9364] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:43:743 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:43:743 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:43:743 [9364] cluster: FindNode() End - OUT
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:43:743 [9364] cluster: FindGroup(): - IN
May 19 12:21:43:743 [9364] cluster: FindGroup(): - OUT
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - pds Deleted
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:21:43:743 [9364] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:43:743 [9364] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:43:744 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:43:744 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:43:744 [9364] cluster: FindNode() End - OUT
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:43:744 [9364] cluster: FindGroup(): - IN
May 19 12:21:43:744 [9364] cluster: FindGroup(): - OUT
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - pds Deleted
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:43:744 [9364] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:43:744 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:43:744 [9364] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:43:744 [9364] cluster: FindNode() End - OUT
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:43:744 [9364] cluster: FindGroup(): - IN
May 19 12:21:43:744 [9364] cluster: FindGroup(): - OUT
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - pds Deleted
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Node Active set to True
May 19 12:21:43:744 [9364] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - starting
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckRestart - end
May 19 12:21:43:744 [9364] cluster: MapResourceGroups(): - OUT
May 19 12:21:43:744 [9364] cluster: doWork - check my resource groups
May 19 12:21:43:744 [9364] cluster: CheckMyResourceGroups(): - IN
May 19 12:21:43:744 [9364] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:21:43:744 [9364] cluster: CheckResourceGroup(): - IN
May 19 12:21:43:744 [9364] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:43:744 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:744 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup(): - OUT
May 19 12:21:43:745 [9364] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup(): - IN
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:21:43:745 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:745 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup(): - OUT
May 19 12:21:43:746 [9364] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup(): - IN
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:21:43:746 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:746 [9364] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:747 [9364] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:21:43:747 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:747 [9364] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:21:43:747 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:747 [9364] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:21:43:747 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:43:747 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:43:748 [9364] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup(): - OUT
May 19 12:21:43:748 [9364] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup(): - IN
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup(): - OUT
May 19 12:21:43:748 [9364] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup(): - IN
May 19 12:21:43:748 [9364] cluster: CheckResourceGroup(): - OUT
May 19 12:21:43:748 [9364] cluster: CheckConfigVersionPds(): - IN
May 19 12:21:43:748 [9364] cluster: PdsSectionMD5(): - IN
May 19 12:21:43:748 [9364] cluster: PdsFromSection(): - IN
May 19 12:21:43:749 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:749 [9364] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:21:43:749 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:749 [9364] cluster: PdsFromSection(): - OUT
May 19 12:21:43:749 [9364] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:21:43:749 [9364] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:21:43:749 [9364] cluster: PdsSectionMD5(): - OUT
May 19 12:21:43:749 [9364] cluster: PdsSectionMD5(): - IN
May 19 12:21:43:749 [9364] cluster: PdsFromSection(): - IN
May 19 12:21:43:749 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:749 [9364] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:21:43:749 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:749 [9364] cluster: PdsFromSection(): - OUT
May 19 12:21:43:749 [9364] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:21:43:749 [9364] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:21:43:749 [9364] cluster: PdsSectionMD5(): - OUT
May 19 12:21:43:749 [9364] cluster: PdsSectionMD5(): - IN
May 19 12:21:43:749 [9364] cluster: PdsFromSection(): - IN
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:750 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:750 [9364] cluster: PdsFromSection(): - OUT
May 19 12:21:43:750 [9364] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:21:43:751 [9364] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:21:43:751 [9364] cluster: PdsSectionMD5(): - OUT
May 19 12:21:43:751 [9364] cluster: PdsSectionMD5(): - IN
May 19 12:21:43:751 [9364] cluster: PdsFromSection(): - IN
May 19 12:21:43:751 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:751 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:21:43:751 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:751 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:21:43:751 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:751 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:751 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:21:43:751 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:751 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:751 [9364] cluster: PdsFromSection(): - OUT
May 19 12:21:43:751 [9364] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:21:43:751 [9364] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:21:43:751 [9364] cluster: PdsSectionMD5(): - OUT
May 19 12:21:43:751 [9364] cluster: PdsSectionMD5(): - IN
May 19 12:21:43:751 [9364] cluster: PdsFromSection(): - IN
May 19 12:21:43:752 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:752 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:21:43:752 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:752 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:21:43:752 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:752 [9364] cluster: recursive_section2pds(): - IN
May 19 12:21:43:752 [9364] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:21:43:752 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:752 [9364] cluster: recursive_section2pds(): - OUT
May 19 12:21:43:752 [9364] cluster: PdsFromSection(): - OUT
May 19 12:21:43:752 [9364] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:21:43:752 [9364] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:21:43:752 [9364] cluster: PdsSectionMD5(): - OUT
May 19 12:21:43:752 [9364] cluster: CheckConfigVersionPds(): - OUT
May 19 12:21:43:752 [9364] cluster: CheckMyResourceGroups(): - OUT
May 19 12:21:43:752 [9364] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:44:491 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:45:492 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:45:724 [8520] cluster: (Main)update node & group conf is starting in thread 10964
May 19 12:21:45:724 [8520] cluster: main - adding Sleep 10
May 19 12:21:45:724 [10964] cluster: doWork(): - IN
May 19 12:21:45:724 [10964] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:46:493 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:47:494 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:47:726 [8520] cluster: (Main)update node & group conf is starting in thread 6676
May 19 12:21:47:726 [8520] cluster: main - adding Sleep 10
May 19 12:21:47:726 [6676] cluster: doWork(): - IN
May 19 12:21:47:726 [6676] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:48:494 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:49:495 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:49:727 [8520] cluster: (Main)update node & group conf is starting in thread 15408
May 19 12:21:49:727 [8520] cluster: main - adding Sleep 10
May 19 12:21:49:727 [15408] cluster: doWork(): - IN
May 19 12:21:49:727 [15408] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:50:496 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:51:497 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:51:729 [8520] cluster: (Main)update node & group conf is starting in thread 21144
May 19 12:21:51:729 [8520] cluster: main - adding Sleep 10
May 19 12:21:51:729 [21144] cluster: doWork(): - IN
May 19 12:21:51:729 [21144] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:52:498 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:53:499 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:53:731 [8520] cluster: (Main)update node & group conf is starting in thread 7504
May 19 12:21:53:731 [8520] cluster: main - adding Sleep 10
May 19 12:21:53:731 [7504] cluster: doWork(): - IN
May 19 12:21:53:731 [7504] cluster: doWork - check groups
May 19 12:21:53:731 [7504] cluster: MapResourceGroups(): - IN
May 19 12:21:53:731 [7504] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:53:753 [7504] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:53:753 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:53:753 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:53:753 [7504] cluster: FindNode() End - OUT
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:53:753 [7504] cluster: FindGroup(): - IN
May 19 12:21:53:753 [7504] cluster: FindGroup(): - OUT
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - pds Deleted
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:53:753 [7504] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:53:753 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:53:753 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:53:753 [7504] cluster: FindNode() End - OUT
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:53:753 [7504] cluster: FindGroup(): - IN
May 19 12:21:53:753 [7504] cluster: FindGroup(): - OUT
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - pds Deleted
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:53:753 [7504] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:53:754 [7504] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:53:754 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:53:754 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:53:754 [7504] cluster: FindNode() End - OUT
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:53:754 [7504] cluster: FindGroup(): - IN
May 19 12:21:53:754 [7504] cluster: FindGroup(): - OUT
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - pds Deleted
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:53:754 [7504] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:53:754 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:53:754 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:53:754 [7504] cluster: FindNode() End - OUT
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:53:754 [7504] cluster: FindGroup(): - IN
May 19 12:21:53:754 [7504] cluster: FindGroup(): - OUT
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - pds Deleted
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:21:53:754 [7504] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:21:53:754 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:21:53:754 [7504] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:21:53:754 [7504] cluster: FindNode() End - OUT
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:21:53:754 [7504] cluster: FindGroup(): - IN
May 19 12:21:53:754 [7504] cluster: FindGroup(): - OUT
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Group state set to 0
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - pds Deleted
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Node Active set to True
May 19 12:21:53:754 [7504] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - starting
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckRestart - end
May 19 12:21:53:754 [7504] cluster: MapResourceGroups(): - OUT
May 19 12:21:53:754 [7504] cluster: doWork - check my resource groups
May 19 12:21:53:754 [7504] cluster: CheckMyResourceGroups(): - IN
May 19 12:21:53:754 [7504] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:21:53:754 [7504] cluster: CheckResourceGroup(): - IN
May 19 12:21:53:754 [7504] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:53:754 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:53:754 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:755 [7504] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:21:53:755 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:755 [7504] cluster: CheckResourceGroup(): - OUT
May 19 12:21:53:755 [7504] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:21:53:755 [7504] cluster: CheckResourceGroup(): - IN
May 19 12:21:53:755 [7504] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:53:755 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:21:53:755 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup(): - OUT
May 19 12:21:53:756 [7504] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup(): - IN
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:21:53:756 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:756 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:757 [7504] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:21:53:757 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:757 [7504] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:21:53:757 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:757 [7504] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:21:53:757 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:757 [7504] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:21:53:758 [7504] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource(): - IN
May 19 12:21:53:758 [7504] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:21:53:759 [7504] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:21:53:759 [7504] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:759 [7504] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:21:53:759 [7504] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:21:53:759 [7504] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:21:53:759 [7504] cluster: CheckResourceGroup(): - OUT
May 19 12:21:53:759 [7504] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:21:53:759 [7504] cluster: CheckResourceGroup(): - IN
May 19 12:21:53:759 [7504] cluster: CheckResourceGroup(): - OUT
May 19 12:21:53:759 [7504] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:21:53:759 [7504] cluster: CheckResourceGroup(): - IN
May 19 12:21:53:759 [7504] cluster: CheckResourceGroup(): - OUT
May 19 12:21:53:759 [7504] cluster: CheckConfigVersionPds(): - IN
May 19 12:21:53:759 [7504] cluster: PdsSectionMD5(): - IN
May 19 12:21:53:759 [7504] cluster: PdsFromSection(): - IN
May 19 12:21:53:759 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:759 [7504] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:21:53:759 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:759 [7504] cluster: PdsFromSection(): - OUT
May 19 12:21:53:759 [7504] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:21:53:759 [7504] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:21:53:759 [7504] cluster: PdsSectionMD5(): - OUT
May 19 12:21:53:759 [7504] cluster: PdsSectionMD5(): - IN
May 19 12:21:53:759 [7504] cluster: PdsFromSection(): - IN
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:760 [7504] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:760 [7504] cluster: PdsFromSection(): - OUT
May 19 12:21:53:760 [7504] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:21:53:760 [7504] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:21:53:760 [7504] cluster: PdsSectionMD5(): - OUT
May 19 12:21:53:760 [7504] cluster: PdsSectionMD5(): - IN
May 19 12:21:53:760 [7504] cluster: PdsFromSection(): - IN
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:760 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:760 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:760 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:760 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: PdsFromSection(): - OUT
May 19 12:21:53:761 [7504] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:21:53:761 [7504] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:21:53:761 [7504] cluster: PdsSectionMD5(): - OUT
May 19 12:21:53:761 [7504] cluster: PdsSectionMD5(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection(): - IN
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:761 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:21:53:761 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:762 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:762 [7504] cluster: PdsFromSection(): - OUT
May 19 12:21:53:762 [7504] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:21:53:762 [7504] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:21:53:762 [7504] cluster: PdsSectionMD5(): - OUT
May 19 12:21:53:762 [7504] cluster: PdsSectionMD5(): - IN
May 19 12:21:53:762 [7504] cluster: PdsFromSection(): - IN
May 19 12:21:53:762 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:762 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:21:53:762 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:762 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:21:53:762 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:762 [7504] cluster: recursive_section2pds(): - IN
May 19 12:21:53:762 [7504] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:21:53:762 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:762 [7504] cluster: recursive_section2pds(): - OUT
May 19 12:21:53:762 [7504] cluster: PdsFromSection(): - OUT
May 19 12:21:53:762 [7504] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:21:53:762 [7504] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:21:53:762 [7504] cluster: PdsSectionMD5(): - OUT
May 19 12:21:53:762 [7504] cluster: CheckConfigVersionPds(): - OUT
May 19 12:21:53:762 [7504] cluster: CheckMyResourceGroups(): - OUT
May 19 12:21:53:762 [7504] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:54:499 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:55:500 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:55:733 [8520] cluster: (Main)update node & group conf is starting in thread 12260
May 19 12:21:55:733 [8520] cluster: main - adding Sleep 10
May 19 12:21:55:733 [12260] cluster: doWork(): - IN
May 19 12:21:55:733 [12260] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:56:501 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:57:502 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:57:734 [8520] cluster: (Main)update node & group conf is starting in thread 10748
May 19 12:21:57:734 [8520] cluster: main - adding Sleep 10
May 19 12:21:57:734 [10748] cluster: doWork(): - IN
May 19 12:21:57:734 [10748] cluster: node_state_resgroup_thread(): - OUT
May 19 12:21:58:503 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:59:484 [16928] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:21:59:484 [16928] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:21:59:484 [16928] cluster: (updateGroupConf) - Finished!
May 19 12:21:59:484 [16928] cluster: updateGroupConf(): - OUT
May 19 12:21:59:484 [16928] cluster:  (update_node_group_conf_thread) Releasing gRestartCallbackLock 
May 19 12:21:59:504 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:21:59:736 [8520] cluster: (Main)update node & group conf is starting in thread 10532
May 19 12:21:59:736 [8520] cluster: main - adding Sleep 10
May 19 12:21:59:736 [10532] cluster: doWork(): - IN
May 19 12:21:59:736 [10532] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:00:505 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:01:505 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:01:738 [8520] cluster: (Main)update node & group conf is starting in thread 20316
May 19 12:22:01:738 [8520] cluster: main - adding Sleep 10
May 19 12:22:01:738 [20316] cluster: doWork(): - IN
May 19 12:22:01:738 [20316] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:02:506 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:03:507 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:03:739 [8520] cluster: (Main)update node & group conf is starting in thread 2568
May 19 12:22:03:739 [8520] cluster: main - adding Sleep 10
May 19 12:22:03:739 [2568] cluster: doWork(): - IN
May 19 12:22:03:739 [2568] cluster: doWork - check groups
May 19 12:22:03:739 [2568] cluster: MapResourceGroups(): - IN
May 19 12:22:03:739 [2568] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:22:03:761 [2568] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:03:761 [2568] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:03:761 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:03:761 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:03:761 [2568] cluster: FindNode() End - OUT
May 19 12:22:03:761 [2568] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:03:761 [2568] cluster: FindGroup(): - IN
May 19 12:22:03:761 [2568] cluster: FindGroup(): - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - pds Deleted
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:03:762 [2568] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:03:762 [2568] cluster: FindNode() End - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:03:762 [2568] cluster: FindGroup(): - IN
May 19 12:22:03:762 [2568] cluster: FindGroup(): - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - pds Deleted
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:03:762 [2568] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:03:762 [2568] cluster: FindNode() End - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:03:762 [2568] cluster: FindGroup(): - IN
May 19 12:22:03:762 [2568] cluster: FindGroup(): - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - pds Deleted
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:03:762 [2568] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:03:762 [2568] cluster: FindNode() End - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:03:762 [2568] cluster: FindGroup(): - IN
May 19 12:22:03:762 [2568] cluster: FindGroup(): - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - pds Deleted
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:03:762 [2568] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:03:762 [2568] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:03:762 [2568] cluster: FindNode() End - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:03:762 [2568] cluster: FindGroup(): - IN
May 19 12:22:03:762 [2568] cluster: FindGroup(): - OUT
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:03:762 [2568] cluster: MapResourceGroups - pds Deleted
May 19 12:22:03:763 [2568] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:03:763 [2568] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:22:03:763 [2568] cluster: MapResourceGroups - Node Active set to True
May 19 12:22:03:763 [2568] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - starting
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckRestart - end
May 19 12:22:03:763 [2568] cluster: MapResourceGroups(): - OUT
May 19 12:22:03:763 [2568] cluster: doWork - check my resource groups
May 19 12:22:03:763 [2568] cluster: CheckMyResourceGroups(): - IN
May 19 12:22:03:763 [2568] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:22:03:763 [2568] cluster: CheckResourceGroup(): - IN
May 19 12:22:03:763 [2568] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:03:763 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:763 [2568] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:22:03:763 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:763 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup(): - OUT
May 19 12:22:03:764 [2568] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup(): - IN
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup(): - OUT
May 19 12:22:03:764 [2568] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup(): - IN
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:03:764 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:764 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:765 [2568] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:22:03:765 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:765 [2568] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:22:03:765 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:765 [2568] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:22:03:765 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:765 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:766 [2568] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:22:03:766 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:766 [2568] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:22:03:766 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:766 [2568] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:22:03:766 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:766 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:767 [2568] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:22:03:767 [2568] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:03:767 [2568] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:03:767 [2568] cluster: CheckResourceGroup(): - OUT
May 19 12:22:03:767 [2568] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:22:03:767 [2568] cluster: CheckResourceGroup(): - IN
May 19 12:22:03:767 [2568] cluster: CheckResourceGroup(): - OUT
May 19 12:22:03:767 [2568] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:22:03:767 [2568] cluster: CheckResourceGroup(): - IN
May 19 12:22:03:767 [2568] cluster: CheckResourceGroup(): - OUT
May 19 12:22:03:767 [2568] cluster: CheckConfigVersionPds(): - IN
May 19 12:22:03:767 [2568] cluster: PdsSectionMD5(): - IN
May 19 12:22:03:767 [2568] cluster: PdsFromSection(): - IN
May 19 12:22:03:768 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:768 [2568] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:22:03:768 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:768 [2568] cluster: PdsFromSection(): - OUT
May 19 12:22:03:768 [2568] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:22:03:768 [2568] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:03:768 [2568] cluster: PdsSectionMD5(): - OUT
May 19 12:22:03:768 [2568] cluster: PdsSectionMD5(): - IN
May 19 12:22:03:768 [2568] cluster: PdsFromSection(): - IN
May 19 12:22:03:768 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:768 [2568] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:22:03:768 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:768 [2568] cluster: PdsFromSection(): - OUT
May 19 12:22:03:768 [2568] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:22:03:768 [2568] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:03:768 [2568] cluster: PdsSectionMD5(): - OUT
May 19 12:22:03:768 [2568] cluster: PdsSectionMD5(): - IN
May 19 12:22:03:768 [2568] cluster: PdsFromSection(): - IN
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:769 [2568] cluster: PdsFromSection(): - OUT
May 19 12:22:03:769 [2568] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:22:03:769 [2568] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:22:03:769 [2568] cluster: PdsSectionMD5(): - OUT
May 19 12:22:03:769 [2568] cluster: PdsSectionMD5(): - IN
May 19 12:22:03:769 [2568] cluster: PdsFromSection(): - IN
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:770 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:770 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:770 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:770 [2568] cluster: PdsFromSection(): - OUT
May 19 12:22:03:770 [2568] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:22:03:770 [2568] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:22:03:770 [2568] cluster: PdsSectionMD5(): - OUT
May 19 12:22:03:770 [2568] cluster: PdsSectionMD5(): - IN
May 19 12:22:03:770 [2568] cluster: PdsFromSection(): - IN
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:770 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:770 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:22:03:770 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:771 [2568] cluster: recursive_section2pds(): - IN
May 19 12:22:03:771 [2568] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:22:03:771 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:771 [2568] cluster: recursive_section2pds(): - OUT
May 19 12:22:03:771 [2568] cluster: PdsFromSection(): - OUT
May 19 12:22:03:771 [2568] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:22:03:771 [2568] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:22:03:771 [2568] cluster: PdsSectionMD5(): - OUT
May 19 12:22:03:771 [2568] cluster: CheckConfigVersionPds(): - OUT
May 19 12:22:03:771 [2568] cluster: CheckMyResourceGroups(): - OUT
May 19 12:22:03:771 [2568] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:04:508 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:05:509 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:05:741 [8520] cluster: (Main)update node & group conf is starting in thread 21932
May 19 12:22:05:741 [8520] cluster: main - adding Sleep 10
May 19 12:22:05:741 [21932] cluster: doWork(): - IN
May 19 12:22:05:741 [21932] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:06:510 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:07:510 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:07:743 [8520] cluster: (Main)update node & group conf is starting in thread 15600
May 19 12:22:07:743 [8520] cluster: main - adding Sleep 10
May 19 12:22:07:743 [15600] cluster: doWork(): - IN
May 19 12:22:07:743 [15600] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:08:511 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:09:512 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:09:744 [8520] cluster: (Main)update node & group conf is starting in thread 7076
May 19 12:22:09:744 [8520] cluster: main - adding Sleep 10
May 19 12:22:09:744 [7076] cluster: doWork(): - IN
May 19 12:22:09:744 [7076] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:10:513 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:10:799 [8520] cluster: RREQUEST: _status <-10.27.163.135/56292  h=371 d=0
May 19 12:22:10:800 [8520] cluster: SREPLY: status = 0(OK) ->10.27.163.135/56292
May 19 12:22:10:800 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:22:10:800 [8520] cluster: RREQUEST: _close <-10.27.163.135/56292  h=370 d=0
May 19 12:22:10:800 [8520] cluster: sockClose:0000000000B5C430:10.27.163.135/48008
May 19 12:22:11:514 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:11:801 [8520] cluster: (Main)update node & group conf is starting in thread 10188
May 19 12:22:11:801 [8520] cluster: main - adding Sleep 10
May 19 12:22:11:801 [10188] cluster: doWork(): - IN
May 19 12:22:11:801 [10188] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:12:515 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:13:515 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:13:803 [8520] cluster: (Main)update node & group conf is starting in thread 20860
May 19 12:22:13:803 [8520] cluster: main - adding Sleep 10
May 19 12:22:13:803 [20860] cluster: doWork(): - IN
May 19 12:22:13:803 [20860] cluster: doWork - check groups
May 19 12:22:13:803 [20860] cluster: MapResourceGroups(): - IN
May 19 12:22:13:803 [20860] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:22:13:824 [20860] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:13:824 [20860] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:13:824 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:13:824 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:13:824 [20860] cluster: FindNode() End - OUT
May 19 12:22:13:824 [20860] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:13:824 [20860] cluster: FindGroup(): - IN
May 19 12:22:13:824 [20860] cluster: FindGroup(): - OUT
May 19 12:22:13:824 [20860] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:22:13:824 [20860] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:22:13:824 [20860] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - pds Deleted
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:13:825 [20860] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:13:825 [20860] cluster: FindNode() End - OUT
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:13:825 [20860] cluster: FindGroup(): - IN
May 19 12:22:13:825 [20860] cluster: FindGroup(): - OUT
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - pds Deleted
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:13:825 [20860] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:13:825 [20860] cluster: FindNode() End - OUT
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:13:825 [20860] cluster: FindGroup(): - IN
May 19 12:22:13:825 [20860] cluster: FindGroup(): - OUT
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - pds Deleted
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:13:825 [20860] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:13:825 [20860] cluster: FindNode() End - OUT
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:13:825 [20860] cluster: FindGroup(): - IN
May 19 12:22:13:825 [20860] cluster: FindGroup(): - OUT
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - pds Deleted
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:13:825 [20860] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:13:825 [20860] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:13:825 [20860] cluster: FindNode() End - OUT
May 19 12:22:13:825 [20860] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:13:825 [20860] cluster: FindGroup(): - IN
May 19 12:22:13:826 [20860] cluster: FindGroup(): - OUT
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - pds Deleted
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - Node Active set to True
May 19 12:22:13:826 [20860] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - starting
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckRestart - end
May 19 12:22:13:826 [20860] cluster: MapResourceGroups(): - OUT
May 19 12:22:13:826 [20860] cluster: doWork - check my resource groups
May 19 12:22:13:826 [20860] cluster: CheckMyResourceGroups(): - IN
May 19 12:22:13:826 [20860] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:22:13:826 [20860] cluster: CheckResourceGroup(): - IN
May 19 12:22:13:826 [20860] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:13:826 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:826 [20860] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:22:13:826 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:22:13:826 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:827 [20860] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup(): - IN
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:827 [20860] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup(): - IN
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - IN
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - IN
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckConfigVersionPds(): - IN
May 19 12:22:13:830 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:830 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:830 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:830 [20860] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:22:13:830 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:830 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:830 [20860] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:22:13:830 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:831 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:831 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:831 [20860] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:22:13:831 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:831 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:831 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:832 [20860] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:22:13:832 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:22:13:832 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:832 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:833 [20860] cluster: CheckConfigVersionPds(): - OUT
May 19 12:22:13:833 [20860] cluster: CheckMyResourceGroups(): - OUT
May 19 12:22:13:833 [20860] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:14:516 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:15:517 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:15:804 [8520] cluster: (Main)update node & group conf is starting in thread 12332
May 19 12:22:15:804 [8520] cluster: main - adding Sleep 10
May 19 12:22:15:804 [12332] cluster: doWork(): - IN
May 19 12:22:15:804 [12332] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:16:518 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:17:519 [20420] cluster: update node & group conf is starting in thread 16744
May 19 12:22:17:519 [16744] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:22:17:519 [16744] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:22:17:519 [16744] cluster: child udp_thread
May 19 12:22:17:519 [16744] cluster: child udp - Update node configs
May 19 12:22:17:519 [16744] cluster: updateNodeConf(): - IN
May 19 12:22:17:519 [16744] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:22:17:519 [16744] cluster: NodeConfigurationRequest(): - IN
May 19 12:22:17:519 [16744] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:22:17:519 [16744] cluster: PdsFromSection(): - IN
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster size=74
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: PdsFromSection(): - OUT
May 19 12:22:17:520 [16744] cluster: NodeConfigurationRequest(): - OUT
May 19 12:22:17:520 [16744] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:22:17:806 [8520] cluster: (Main)update node & group conf is starting in thread 17380
May 19 12:22:17:806 [8520] cluster: main - adding Sleep 10
May 19 12:22:17:806 [17380] cluster: doWork(): - IN
May 19 12:22:17:806 [17380] cluster: doWork - check nodes - do connection
May 19 12:22:17:806 [17380] cluster: ConnectAllNodes(): - IN
May 19 12:22:17:806 [17380] cluster: (ConnectAllNodes) - Start
May 19 12:22:17:806 [17380] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:22:17:806 [17380] cluster: ConnectToNode(): - IN
May 19 12:22:17:806 [17380] cluster: controller port is 48000
May 19 12:22:18:500 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:18:500 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56576  h=298 d=1417
May 19 12:22:18:500 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:22:18:500 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:22:18:500 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:22:18:500 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:22:18:500 [20420] cluster: set_node_version - from 10.27.163.134/56576 [0xb79d70]
May 19 12:22:18:500 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:22:18:500 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:22:18:500 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56576
May 19 12:22:18:500 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:22:18:500 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:22:18:500 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:22:18:500 [20420] cluster: RREQUEST: _close <-10.27.163.134/56576  h=287 d=0
May 19 12:22:18:500 [20420] cluster: sockClose:0000000000B79D70:10.27.163.135/48003
May 19 12:22:18:501 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56577  h=299 d=866
May 19 12:22:18:501 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:22:18:501 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:22:18:501 [20420] cluster: set_group_version - from 10.27.163.134/56577 [0xb79d70]
May 19 12:22:18:502 [20420] cluster: set_group_version - pds received, size=866
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:22:18:502 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:22:18:502 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:22:18:502 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:22:18:502 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:22:18:502 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56577
May 19 12:22:18:502 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:22:18:502 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:22:18:502 [20420] cluster: RREQUEST: _close <-10.27.163.134/56577  h=287 d=0
May 19 12:22:18:503 [20420] cluster: sockClose:0000000000B79D70:10.27.163.135/48003
May 19 12:22:19:503 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:19:808 [8520] cluster: main - adding Sleep 10
May 19 12:22:20:504 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:21:505 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:21:809 [8520] cluster: main - adding Sleep 10
May 19 12:22:22:506 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:22:806 [17380] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:22:22:806 [17380] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:22:22:806 [17380] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:22:22:806 [17380] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:22:22:806 [17380] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:22:22:806 [17380] cluster: ConnectAllNodes(): - OUT
May 19 12:22:22:806 [17380] cluster: Not connected to any nodes!
May 19 12:22:22:806 [17380] cluster: doWork - check nodes - state
May 19 12:22:22:806 [17380] cluster: CheckNodeState(): - Starting IN
May 19 12:22:22:813 [17380] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:22:813 [17380] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:22:813 [17380] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:22:813 [17380] cluster: FindNode() End - OUT
May 19 12:22:22:813 [17380] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:22:22:813 [17380] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:22:22:813 [17380] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:22:813 [17380] cluster: FindNode() End - OUT
May 19 12:22:22:813 [17380] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:22:22:813 [17380] cluster: CheckNodeState(): - OUT
May 19 12:22:22:813 [17380] cluster: doWork - check nodes - any new probes installed
May 19 12:22:22:813 [17380] cluster: ProbeInfoCheck(): - IN
May 19 12:22:22:814 [17380] cluster: ProbeInfoCheck(): - OUT
May 19 12:22:22:814 [17380] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:23:507 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:23:811 [8520] cluster: (Main)update node & group conf is starting in thread 18100
May 19 12:22:23:811 [8520] cluster: main - adding Sleep 10
May 19 12:22:23:811 [18100] cluster: doWork(): - IN
May 19 12:22:23:811 [18100] cluster: doWork - check groups
May 19 12:22:23:811 [18100] cluster: MapResourceGroups(): - IN
May 19 12:22:23:811 [18100] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:23:834 [18100] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:23:834 [18100] cluster: FindNode() End - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:23:834 [18100] cluster: FindGroup(): - IN
May 19 12:22:23:834 [18100] cluster: FindGroup(): - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:22:13:827 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:827 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:22:13:828 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:828 [20860] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:22:13:829 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:829 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:13:830 [20860] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - IN
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - IN
May 19 12:22:13:830 [20860] cluster: CheckResourceGroup(): - OUT
May 19 12:22:13:830 [20860] cluster: CheckConfigVersionPds(): - IN
May 19 12:22:13:830 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:830 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:830 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:830 [20860] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:22:13:830 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:830 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:830 [20860] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:22:13:830 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:831 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:831 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:831 [20860] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:22:13:831 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:831 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:831 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:831 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:832 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:832 [20860] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:22:13:832 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:22:13:832 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:832 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:832 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection(): - IN
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - IN
May 19 12:22:13:833 [20860] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: recursive_section2pds(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsFromSection(): - OUT
May 19 12:22:13:833 [20860] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:22:13:833 [20860] cluster: PdsSectionMD5(): - OUT
May 19 12:22:13:833 [20860] cluster: CheckConfigVersionPds(): - OUT
May 19 12:22:13:833 [20860] cluster: CheckMyResourceGroups(): - OUT
May 19 12:22:13:833 [20860] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:14:516 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:15:517 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:15:804 [8520] cluster: (Main)update node & group conf is starting in thread 12332
May 19 12:22:15:804 [8520] cluster: main - adding Sleep 10
May 19 12:22:15:804 [12332] cluster: doWork(): - IN
May 19 12:22:15:804 [12332] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:16:518 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:17:519 [20420] cluster: update node & group conf is starting in thread 16744
May 19 12:22:17:519 [16744] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:22:17:519 [16744] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:22:17:519 [16744] cluster: child udp_thread
May 19 12:22:17:519 [16744] cluster: child udp - Update node configs
May 19 12:22:17:519 [16744] cluster: updateNodeConf(): - IN
May 19 12:22:17:519 [16744] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:22:17:519 [16744] cluster: NodeConfigurationRequest(): - IN
May 19 12:22:17:519 [16744] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:22:17:519 [16744] cluster: PdsFromSection(): - IN
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster size=74
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - IN
May 19 12:22:17:520 [16744] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: recursive_section2pds(): - OUT
May 19 12:22:17:520 [16744] cluster: PdsFromSection(): - OUT
May 19 12:22:17:520 [16744] cluster: NodeConfigurationRequest(): - OUT
May 19 12:22:17:520 [16744] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:22:17:806 [8520] cluster: (Main)update node & group conf is starting in thread 17380
May 19 12:22:17:806 [8520] cluster: main - adding Sleep 10
May 19 12:22:17:806 [17380] cluster: doWork(): - IN
May 19 12:22:17:806 [17380] cluster: doWork - check nodes - do connection
May 19 12:22:17:806 [17380] cluster: ConnectAllNodes(): - IN
May 19 12:22:17:806 [17380] cluster: (ConnectAllNodes) - Start
May 19 12:22:17:806 [17380] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:22:17:806 [17380] cluster: ConnectToNode(): - IN
May 19 12:22:17:806 [17380] cluster: controller port is 48000
May 19 12:22:18:500 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:18:500 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56576  h=298 d=1417
May 19 12:22:18:500 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:22:18:500 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:22:18:500 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:22:18:500 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:22:18:500 [20420] cluster: set_node_version - from 10.27.163.134/56576 [0xb79d70]
May 19 12:22:18:500 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:22:18:500 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:22:18:500 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56576
May 19 12:22:18:500 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:22:18:500 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:22:18:500 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:22:18:500 [20420] cluster: RREQUEST: _close <-10.27.163.134/56576  h=287 d=0
May 19 12:22:18:500 [20420] cluster: sockClose:0000000000B79D70:10.27.163.135/48003
May 19 12:22:18:501 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56577  h=299 d=866
May 19 12:22:18:501 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:22:18:501 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:22:18:501 [20420] cluster: set_group_version - from 10.27.163.134/56577 [0xb79d70]
May 19 12:22:18:502 [20420] cluster: set_group_version - pds received, size=866
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:22:18:502 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:22:18:502 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:22:18:502 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:22:18:502 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:22:18:502 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:22:18:502 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56577
May 19 12:22:18:502 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:22:18:502 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:22:18:502 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:22:18:502 [20420] cluster: RREQUEST: _close <-10.27.163.134/56577  h=287 d=0
May 19 12:22:18:503 [20420] cluster: sockClose:0000000000B79D70:10.27.163.135/48003
May 19 12:22:19:503 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:19:808 [8520] cluster: main - adding Sleep 10
May 19 12:22:20:504 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:21:505 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:21:809 [8520] cluster: main - adding Sleep 10
May 19 12:22:22:506 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:22:806 [17380] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:22:22:806 [17380] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:22:22:806 [17380] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:22:22:806 [17380] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:22:22:806 [17380] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:22:22:806 [17380] cluster: ConnectAllNodes(): - OUT
May 19 12:22:22:806 [17380] cluster: Not connected to any nodes!
May 19 12:22:22:806 [17380] cluster: doWork - check nodes - state
May 19 12:22:22:806 [17380] cluster: CheckNodeState(): - Starting IN
May 19 12:22:22:813 [17380] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:22:813 [17380] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:22:813 [17380] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:22:813 [17380] cluster: FindNode() End - OUT
May 19 12:22:22:813 [17380] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:22:22:813 [17380] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:22:22:813 [17380] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:22:813 [17380] cluster: FindNode() End - OUT
May 19 12:22:22:813 [17380] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:22:22:813 [17380] cluster: CheckNodeState(): - OUT
May 19 12:22:22:813 [17380] cluster: doWork - check nodes - any new probes installed
May 19 12:22:22:813 [17380] cluster: ProbeInfoCheck(): - IN
May 19 12:22:22:814 [17380] cluster: ProbeInfoCheck(): - OUT
May 19 12:22:22:814 [17380] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:23:507 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:23:811 [8520] cluster: (Main)update node & group conf is starting in thread 18100
May 19 12:22:23:811 [8520] cluster: main - adding Sleep 10
May 19 12:22:23:811 [18100] cluster: doWork(): - IN
May 19 12:22:23:811 [18100] cluster: doWork - check groups
May 19 12:22:23:811 [18100] cluster: MapResourceGroups(): - IN
May 19 12:22:23:811 [18100] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:23:834 [18100] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:23:834 [18100] cluster: FindNode() End - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:23:834 [18100] cluster: FindGroup(): - IN
May 19 12:22:23:834 [18100] cluster: FindGroup(): - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - pds Deleted
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:23:834 [18100] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:23:834 [18100] cluster: FindNode() End - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:23:834 [18100] cluster: FindGroup(): - IN
May 19 12:22:23:834 [18100] cluster: FindGroup(): - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - pds Deleted
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:23:834 [18100] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:23:834 [18100] cluster: FindNode() End - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:23:834 [18100] cluster: FindGroup(): - IN
May 19 12:22:23:834 [18100] cluster: FindGroup(): - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - pds Deleted
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:23:834 [18100] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:23:834 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:23:834 [18100] cluster: FindNode() End - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:23:834 [18100] cluster: FindGroup(): - IN
May 19 12:22:23:834 [18100] cluster: FindGroup(): - OUT
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - pds Deleted
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:23:834 [18100] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:23:835 [18100] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:23:835 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:23:835 [18100] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:23:835 [18100] cluster: FindNode() End - OUT
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:23:835 [18100] cluster: FindGroup(): - IN
May 19 12:22:23:835 [18100] cluster: FindGroup(): - OUT
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - pds Deleted
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - Node Active set to True
May 19 12:22:23:835 [18100] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - starting
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckRestart - end
May 19 12:22:23:835 [18100] cluster: MapResourceGroups(): - OUT
May 19 12:22:23:835 [18100] cluster: doWork - check my resource groups
May 19 12:22:23:835 [18100] cluster: CheckMyResourceGroups(): - IN
May 19 12:22:23:835 [18100] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:22:23:835 [18100] cluster: CheckResourceGroup(): - IN
May 19 12:22:23:835 [18100] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:23:835 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:835 [18100] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:22:23:835 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:23:835 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup(): - OUT
May 19 12:22:23:836 [18100] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup(): - IN
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup(): - OUT
May 19 12:22:23:836 [18100] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup(): - IN
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:23:836 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:836 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:837 [18100] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:22:23:837 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:837 [18100] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:22:23:837 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:837 [18100] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:22:23:837 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:837 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:838 [18100] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:22:23:838 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:838 [18100] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:22:23:838 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:838 [18100] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:22:23:838 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:838 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:839 [18100] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:22:23:839 [18100] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:23:839 [18100] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:23:839 [18100] cluster: CheckResourceGroup(): - OUT
May 19 12:22:23:839 [18100] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:22:23:839 [18100] cluster: CheckResourceGroup(): - IN
May 19 12:22:23:839 [18100] cluster: CheckResourceGroup(): - OUT
May 19 12:22:23:839 [18100] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:22:23:839 [18100] cluster: CheckResourceGroup(): - IN
May 19 12:22:23:839 [18100] cluster: CheckResourceGroup(): - OUT
May 19 12:22:23:839 [18100] cluster: CheckConfigVersionPds(): - IN
May 19 12:22:23:839 [18100] cluster: PdsSectionMD5(): - IN
May 19 12:22:23:839 [18100] cluster: PdsFromSection(): - IN
May 19 12:22:23:840 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:840 [18100] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:22:23:840 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:840 [18100] cluster: PdsFromSection(): - OUT
May 19 12:22:23:840 [18100] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:22:23:840 [18100] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:23:840 [18100] cluster: PdsSectionMD5(): - OUT
May 19 12:22:23:840 [18100] cluster: PdsSectionMD5(): - IN
May 19 12:22:23:840 [18100] cluster: PdsFromSection(): - IN
May 19 12:22:23:840 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:840 [18100] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:22:23:840 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:840 [18100] cluster: PdsFromSection(): - OUT
May 19 12:22:23:840 [18100] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:22:23:840 [18100] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:23:840 [18100] cluster: PdsSectionMD5(): - OUT
May 19 12:22:23:840 [18100] cluster: PdsSectionMD5(): - IN
May 19 12:22:23:840 [18100] cluster: PdsFromSection(): - IN
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:841 [18100] cluster: PdsFromSection(): - OUT
May 19 12:22:23:841 [18100] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:22:23:841 [18100] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:22:23:841 [18100] cluster: PdsSectionMD5(): - OUT
May 19 12:22:23:841 [18100] cluster: PdsSectionMD5(): - IN
May 19 12:22:23:841 [18100] cluster: PdsFromSection(): - IN
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:842 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:842 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:842 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:842 [18100] cluster: PdsFromSection(): - OUT
May 19 12:22:23:842 [18100] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:22:23:842 [18100] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:22:23:842 [18100] cluster: PdsSectionMD5(): - OUT
May 19 12:22:23:842 [18100] cluster: PdsSectionMD5(): - IN
May 19 12:22:23:842 [18100] cluster: PdsFromSection(): - IN
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:842 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:842 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - IN
May 19 12:22:23:842 [18100] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:842 [18100] cluster: recursive_section2pds(): - OUT
May 19 12:22:23:842 [18100] cluster: PdsFromSection(): - OUT
May 19 12:22:23:842 [18100] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:22:23:842 [18100] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:22:23:842 [18100] cluster: PdsSectionMD5(): - OUT
May 19 12:22:23:842 [18100] cluster: CheckConfigVersionPds(): - OUT
May 19 12:22:23:842 [18100] cluster: CheckMyResourceGroups(): - OUT
May 19 12:22:23:842 [18100] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:24:508 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:25:509 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:25:813 [8520] cluster: (Main)update node & group conf is starting in thread 19904
May 19 12:22:25:813 [8520] cluster: main - adding Sleep 10
May 19 12:22:25:813 [19904] cluster: doWork(): - IN
May 19 12:22:25:813 [19904] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:26:509 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:27:510 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:27:814 [8520] cluster: (Main)update node & group conf is starting in thread 6872
May 19 12:22:27:814 [8520] cluster: main - adding Sleep 10
May 19 12:22:27:814 [6872] cluster: doWork(): - IN
May 19 12:22:27:814 [6872] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:28:511 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:29:512 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:29:816 [8520] cluster: (Main)update node & group conf is starting in thread 4788
May 19 12:22:29:816 [8520] cluster: main - adding Sleep 10
May 19 12:22:29:816 [4788] cluster: doWork(): - IN
May 19 12:22:29:816 [4788] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:30:513 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:30:739 [8520] cluster: RREQUEST: set_node_up <-10.27.163.134/56580  h=293 d=106
May 19 12:22:30:739 [8520] cluster: nimSockaddr2Ip - found 10.27.163.134
May 19 12:22:30:739 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:22:30:741 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:22:30:741 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:22:30:741 [8520] cluster:  data   time=1589883750 access=2 ident=31156
May 19 12:22:30:741 [8520] cluster: sockClose:0000000000B79D70:10.27.163.135/56334
May 19 12:22:30:742 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:22:30:742 [8520] cluster: cmd_set_node_up(): - IN
May 19 12:22:30:742 [8520] cluster: set_node_up - from 10.27.163.134/56580 [0xb788b0]
May 19 12:22:30:742 [8520] cluster: cmd_set_node_up(): - OUT
May 19 12:22:30:742 [6992] cluster: thrSetNodeUp(): - IN
May 19 12:22:30:742 [6992] cluster:  (thrSetNodeUp) Waiting gthreadCallbackLock 
May 19 12:22:30:742 [6992] cluster:  (thrSetNodeUp) Locking gthreadCallbackLock 
May 19 12:22:30:742 [6992] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:22:30:742 [6992] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:30:742 [6992] cluster: FindNode() End - OUT
May 19 12:22:30:742 [6992] cluster: thrSetNodeUp - Caller address: /TotalDxim/SDCPPDXIM07/frhdstd-apbct01/cluster, My adress: 10.27.163.135
May 19 12:22:30:742 [6992] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56580
May 19 12:22:30:742 [6992] cluster:  head   mtype=200 status=0 seq=0
May 19 12:22:30:742 [6992] cluster: sockClose:0000000000B788B0:10.27.163.135/48008
May 19 12:22:30:742 [6992] cluster: SREQUEST: _close ->10.27.163.134/56580
May 19 12:22:30:742 [6992] cluster:  (thrSetNodeUp) Releasing gthreadCallbackLock 
May 19 12:22:30:742 [6992] cluster: thrSetNodeUp(): - OUT
May 19 12:22:31:514 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:31:743 [8520] cluster: (Main)update node & group conf is starting in thread 11444
May 19 12:22:31:743 [8520] cluster: main - adding Sleep 10
May 19 12:22:31:743 [11444] cluster: doWork(): - IN
May 19 12:22:31:743 [11444] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:32:514 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:33:515 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:33:744 [8520] cluster: (Main)update node & group conf is starting in thread 20324
May 19 12:22:33:744 [8520] cluster: main - adding Sleep 10
May 19 12:22:33:744 [20324] cluster: doWork(): - IN
May 19 12:22:33:744 [20324] cluster: doWork - check groups
May 19 12:22:33:744 [20324] cluster: MapResourceGroups(): - IN
May 19 12:22:33:744 [20324] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:22:33:766 [20324] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:33:766 [20324] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:33:766 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:33:766 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:33:766 [20324] cluster: FindNode() End - OUT
May 19 12:22:33:766 [20324] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:33:767 [20324] cluster: FindGroup(): - IN
May 19 12:22:33:767 [20324] cluster: FindGroup(): - OUT
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - pds Deleted
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:33:767 [20324] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:33:767 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:33:767 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:33:767 [20324] cluster: FindNode() End - OUT
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:33:767 [20324] cluster: FindGroup(): - IN
May 19 12:22:33:767 [20324] cluster: FindGroup(): - OUT
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - pds Deleted
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:33:767 [20324] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:33:767 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:33:767 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:33:767 [20324] cluster: FindNode() End - OUT
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:33:767 [20324] cluster: FindGroup(): - IN
May 19 12:22:33:767 [20324] cluster: FindGroup(): - OUT
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - pds Deleted
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:33:767 [20324] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:33:767 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:33:767 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:33:767 [20324] cluster: FindNode() End - OUT
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:33:767 [20324] cluster: FindGroup(): - IN
May 19 12:22:33:767 [20324] cluster: FindGroup(): - OUT
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - pds Deleted
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:22:33:767 [20324] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:33:767 [20324] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:33:767 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:33:768 [20324] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:33:768 [20324] cluster: FindNode() End - OUT
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:33:768 [20324] cluster: FindGroup(): - IN
May 19 12:22:33:768 [20324] cluster: FindGroup(): - OUT
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - pds Deleted
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - Node Active set to True
May 19 12:22:33:768 [20324] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - starting
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckRestart - end
May 19 12:22:33:768 [20324] cluster: MapResourceGroups(): - OUT
May 19 12:22:33:768 [20324] cluster: doWork - check my resource groups
May 19 12:22:33:768 [20324] cluster: CheckMyResourceGroups(): - IN
May 19 12:22:33:768 [20324] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:22:33:768 [20324] cluster: CheckResourceGroup(): - IN
May 19 12:22:33:768 [20324] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:33:768 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:768 [20324] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:22:33:768 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:768 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup(): - IN
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup(): - IN
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:770 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:770 [20324] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:22:33:771 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:771 [20324] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:22:33:771 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:771 [20324] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:22:33:771 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:771 [20324] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:22:33:771 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:771 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:772 [20324] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:22:33:772 [20324] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:33:772 [20324] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:33:772 [20324] cluster: CheckResourceGroup(): - OUT
May 19 12:22:33:772 [20324] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:22:33:772 [20324] cluster: CheckResourceGroup(): - IN
May 19 12:22:33:772 [20324] cluster: CheckResourceGroup(): - OUT
May 19 12:22:33:772 [20324] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:22:33:772 [20324] cluster: CheckResourceGroup(): - IN
May 19 12:22:33:772 [20324] cluster: CheckResourceGroup(): - OUT
May 19 12:22:33:772 [20324] cluster: CheckConfigVersionPds(): - IN
May 19 12:22:33:772 [20324] cluster: PdsSectionMD5(): - IN
May 19 12:22:33:772 [20324] cluster: PdsFromSection(): - IN
May 19 12:22:33:773 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:773 [20324] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:22:33:773 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:773 [20324] cluster: PdsFromSection(): - OUT
May 19 12:22:33:773 [20324] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:22:33:773 [20324] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:33:773 [20324] cluster: PdsSectionMD5(): - OUT
May 19 12:22:33:773 [20324] cluster: PdsSectionMD5(): - IN
May 19 12:22:33:773 [20324] cluster: PdsFromSection(): - IN
May 19 12:22:33:773 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:773 [20324] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:22:33:773 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:773 [20324] cluster: PdsFromSection(): - OUT
May 19 12:22:33:773 [20324] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:22:33:773 [20324] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:33:773 [20324] cluster: PdsSectionMD5(): - OUT
May 19 12:22:33:773 [20324] cluster: PdsSectionMD5(): - IN
May 19 12:22:33:773 [20324] cluster: PdsFromSection(): - IN
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: PdsFromSection(): - OUT
May 19 12:22:33:775 [20324] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:22:33:775 [20324] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:22:33:775 [20324] cluster: PdsSectionMD5(): - OUT
May 19 12:22:33:775 [20324] cluster: PdsSectionMD5(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection(): - IN
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:775 [20324] cluster: PdsFromSection(): - OUT
May 19 12:22:33:775 [20324] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:22:33:775 [20324] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:22:33:775 [20324] cluster: PdsSectionMD5(): - OUT
May 19 12:22:33:775 [20324] cluster: PdsSectionMD5(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection(): - IN
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:775 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:22:33:775 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:777 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:22:33:777 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:777 [20324] cluster: recursive_section2pds(): - IN
May 19 12:22:33:777 [20324] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:22:33:777 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:777 [20324] cluster: recursive_section2pds(): - OUT
May 19 12:22:33:777 [20324] cluster: PdsFromSection(): - OUT
May 19 12:22:33:777 [20324] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:22:33:777 [20324] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:22:33:777 [20324] cluster: PdsSectionMD5(): - OUT
May 19 12:22:33:777 [20324] cluster: CheckConfigVersionPds(): - OUT
May 19 12:22:33:777 [20324] cluster: CheckMyResourceGroups(): - OUT
May 19 12:22:33:777 [20324] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:34:516 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:35:517 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:35:746 [8520] cluster: (Main)update node & group conf is starting in thread 21724
May 19 12:22:35:746 [8520] cluster: main - adding Sleep 10
May 19 12:22:35:746 [21724] cluster: doWork(): - IN
May 19 12:22:35:746 [21724] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:36:518 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:37:519 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:37:748 [8520] cluster: (Main)update node & group conf is starting in thread 5048
May 19 12:22:37:748 [8520] cluster: main - adding Sleep 10
May 19 12:22:37:748 [5048] cluster: doWork(): - IN
May 19 12:22:37:748 [5048] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:38:520 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:38:523 [16744] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:22:38:523 [16744] cluster: (updateNodeConf) - Connect to ip/host: 10.30.10.16
May 19 12:22:38:523 [16744] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:22:38:523 [16744] cluster: updateNodeConf(): - OUT
May 19 12:22:38:523 [16744] cluster: child udp - Update group configs
May 19 12:22:38:523 [16744] cluster: updateGroupConf(): - IN
May 19 12:22:38:523 [16744] cluster: (updateGroupConf) - This node ip/host: 10.27.163.135
May 19 12:22:38:523 [16744] cluster: ResourceGroupConfigurationRequest(): - IN
May 19 12:22:38:523 [16744] cluster: ResourceGroupConfigurationRequest(): - OUT
May 19 12:22:38:523 [16744] cluster: (updateGroupConf) - Connect to ip/host: 10.30.10.16, port: 48003
May 19 12:22:39:520 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:39:750 [8520] cluster: (Main)update node & group conf is starting in thread 10640
May 19 12:22:39:750 [8520] cluster: main - adding Sleep 10
May 19 12:22:39:750 [10640] cluster: doWork(): - IN
May 19 12:22:39:750 [10640] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:40:521 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:41:522 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:41:751 [8520] cluster: (Main)update node & group conf is starting in thread 19188
May 19 12:22:41:751 [8520] cluster: main - adding Sleep 10
May 19 12:22:41:751 [19188] cluster: doWork(): - IN
May 19 12:22:41:751 [19188] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:42:523 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:43:524 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:43:753 [8520] cluster: (Main)update node & group conf is starting in thread 10124
May 19 12:22:43:753 [8520] cluster: main - adding Sleep 10
May 19 12:22:43:753 [10124] cluster: doWork(): - IN
May 19 12:22:43:753 [10124] cluster: doWork - check groups
May 19 12:22:43:753 [10124] cluster: MapResourceGroups(): - IN
May 19 12:22:43:753 [10124] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:43:776 [10124] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:43:776 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:43:776 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:43:776 [10124] cluster: FindNode() End - OUT
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:43:776 [10124] cluster: FindGroup(): - IN
May 19 12:22:43:776 [10124] cluster: FindGroup(): - OUT
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - pds Deleted
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:43:776 [10124] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:43:776 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:43:776 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:43:776 [10124] cluster: FindNode() End - OUT
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:43:776 [10124] cluster: FindGroup(): - IN
May 19 12:22:43:776 [10124] cluster: FindGroup(): - OUT
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - pds Deleted
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:43:776 [10124] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:43:777 [10124] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:43:777 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:43:777 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:43:777 [10124] cluster: FindNode() End - OUT
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:43:777 [10124] cluster: FindGroup(): - IN
May 19 12:22:43:777 [10124] cluster: FindGroup(): - OUT
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - pds Deleted
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:43:777 [10124] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:43:777 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:43:777 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:43:777 [10124] cluster: FindNode() End - OUT
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:43:777 [10124] cluster: FindGroup(): - IN
May 19 12:22:43:777 [10124] cluster: FindGroup(): - OUT
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - pds Deleted
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:43:777 [10124] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:43:777 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:43:777 [10124] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:43:777 [10124] cluster: FindNode() End - OUT
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:43:777 [10124] cluster: FindGroup(): - IN
May 19 12:22:43:777 [10124] cluster: FindGroup(): - OUT
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - pds Deleted
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Node Active set to True
May 19 12:22:43:777 [10124] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - starting
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckRestart - end
May 19 12:22:43:777 [10124] cluster: MapResourceGroups(): - OUT
May 19 12:22:43:777 [10124] cluster: doWork - check my resource groups
May 19 12:22:43:777 [10124] cluster: CheckMyResourceGroups(): - IN
May 19 12:22:43:777 [10124] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:22:43:777 [10124] cluster: CheckResourceGroup(): - IN
May 19 12:22:43:777 [10124] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:43:777 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:43:777 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:778 [10124] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:22:43:778 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:778 [10124] cluster: CheckResourceGroup(): - OUT
May 19 12:22:43:778 [10124] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:22:43:778 [10124] cluster: CheckResourceGroup(): - IN
May 19 12:22:43:778 [10124] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:43:778 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:778 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup(): - OUT
May 19 12:22:43:779 [10124] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup(): - IN
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:22:43:779 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:779 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:780 [10124] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:22:43:780 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:780 [10124] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:22:43:780 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:780 [10124] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:22:43:780 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:43:780 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:781 [10124] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:22:43:781 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:781 [10124] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:22:43:781 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:781 [10124] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:22:43:781 [10124] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:781 [10124] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:43:782 [10124] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:43:782 [10124] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:43:782 [10124] cluster: CheckResourceGroup(): - OUT
May 19 12:22:43:782 [10124] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:22:43:782 [10124] cluster: CheckResourceGroup(): - IN
May 19 12:22:43:782 [10124] cluster: CheckResourceGroup(): - OUT
May 19 12:22:43:782 [10124] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:22:43:782 [10124] cluster: CheckResourceGroup(): - IN
May 19 12:22:43:782 [10124] cluster: CheckResourceGroup(): - OUT
May 19 12:22:43:782 [10124] cluster: CheckConfigVersionPds(): - IN
May 19 12:22:43:782 [10124] cluster: PdsSectionMD5(): - IN
May 19 12:22:43:782 [10124] cluster: PdsFromSection(): - IN
May 19 12:22:43:782 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:782 [10124] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:22:43:782 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:782 [10124] cluster: PdsFromSection(): - OUT
May 19 12:22:43:782 [10124] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:22:43:782 [10124] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:43:782 [10124] cluster: PdsSectionMD5(): - OUT
May 19 12:22:43:782 [10124] cluster: PdsSectionMD5(): - IN
May 19 12:22:43:782 [10124] cluster: PdsFromSection(): - IN
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:783 [10124] cluster: PdsFromSection(): - OUT
May 19 12:22:43:783 [10124] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:22:43:783 [10124] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:43:783 [10124] cluster: PdsSectionMD5(): - OUT
May 19 12:22:43:783 [10124] cluster: PdsSectionMD5(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection(): - IN
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:783 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:783 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:784 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:784 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:784 [10124] cluster: PdsFromSection(): - OUT
May 19 12:22:43:784 [10124] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:22:43:784 [10124] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:22:43:784 [10124] cluster: PdsSectionMD5(): - OUT
May 19 12:22:43:784 [10124] cluster: PdsSectionMD5(): - IN
May 19 12:22:43:784 [10124] cluster: PdsFromSection(): - IN
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:784 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:784 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:784 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:784 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:784 [10124] cluster: PdsFromSection(): - OUT
May 19 12:22:43:784 [10124] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:22:43:784 [10124] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:22:43:784 [10124] cluster: PdsSectionMD5(): - OUT
May 19 12:22:43:784 [10124] cluster: PdsSectionMD5(): - IN
May 19 12:22:43:784 [10124] cluster: PdsFromSection(): - IN
May 19 12:22:43:785 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:785 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:22:43:785 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:785 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:22:43:785 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:785 [10124] cluster: recursive_section2pds(): - IN
May 19 12:22:43:785 [10124] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:22:43:785 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:785 [10124] cluster: recursive_section2pds(): - OUT
May 19 12:22:43:785 [10124] cluster: PdsFromSection(): - OUT
May 19 12:22:43:785 [10124] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:22:43:785 [10124] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:22:43:785 [10124] cluster: PdsSectionMD5(): - OUT
May 19 12:22:43:785 [10124] cluster: CheckConfigVersionPds(): - OUT
May 19 12:22:43:785 [10124] cluster: CheckMyResourceGroups(): - OUT
May 19 12:22:43:785 [10124] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:44:525 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:45:525 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:45:755 [8520] cluster: (Main)update node & group conf is starting in thread 7944
May 19 12:22:45:755 [8520] cluster: main - adding Sleep 10
May 19 12:22:45:755 [7944] cluster: doWork(): - IN
May 19 12:22:45:755 [7944] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:46:526 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:47:527 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:47:756 [8520] cluster: (Main)update node & group conf is starting in thread 19544
May 19 12:22:47:756 [8520] cluster: main - adding Sleep 10
May 19 12:22:47:756 [19544] cluster: doWork(): - IN
May 19 12:22:47:756 [19544] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:48:528 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:49:529 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:49:758 [8520] cluster: (Main)update node & group conf is starting in thread 18204
May 19 12:22:49:758 [8520] cluster: main - adding Sleep 10
May 19 12:22:49:758 [18204] cluster: doWork(): - IN
May 19 12:22:49:758 [18204] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:50:530 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:51:530 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:51:760 [8520] cluster: (Main)update node & group conf is starting in thread 17468
May 19 12:22:51:760 [8520] cluster: main - adding Sleep 10
May 19 12:22:51:760 [17468] cluster: doWork(): - IN
May 19 12:22:51:760 [17468] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:52:531 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:53:532 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:53:761 [8520] cluster: (Main)update node & group conf is starting in thread 9920
May 19 12:22:53:761 [8520] cluster: main - adding Sleep 10
May 19 12:22:53:761 [9920] cluster: doWork(): - IN
May 19 12:22:53:761 [9920] cluster: doWork - check groups
May 19 12:22:53:761 [9920] cluster: MapResourceGroups(): - IN
May 19 12:22:53:761 [9920] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:53:784 [9920] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:53:784 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:53:784 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:53:784 [9920] cluster: FindNode() End - OUT
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:53:784 [9920] cluster: FindGroup(): - IN
May 19 12:22:53:784 [9920] cluster: FindGroup(): - OUT
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - pds Deleted
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:53:784 [9920] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:53:784 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:53:784 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:53:784 [9920] cluster: FindNode() End - OUT
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:53:784 [9920] cluster: FindGroup(): - IN
May 19 12:22:53:784 [9920] cluster: FindGroup(): - OUT
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - pds Deleted
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:53:784 [9920] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:53:784 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:53:784 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:53:784 [9920] cluster: FindNode() End - OUT
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:53:784 [9920] cluster: FindGroup(): - IN
May 19 12:22:53:784 [9920] cluster: FindGroup(): - OUT
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - pds Deleted
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:53:784 [9920] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:53:785 [9920] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:53:785 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:53:785 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:53:785 [9920] cluster: FindNode() End - OUT
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:53:785 [9920] cluster: FindGroup(): - IN
May 19 12:22:53:785 [9920] cluster: FindGroup(): - OUT
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - pds Deleted
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:22:53:785 [9920] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:22:53:785 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:22:53:785 [9920] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:22:53:785 [9920] cluster: FindNode() End - OUT
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:22:53:785 [9920] cluster: FindGroup(): - IN
May 19 12:22:53:785 [9920] cluster: FindGroup(): - OUT
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Group state set to 0
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - pds Deleted
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Node Active set to True
May 19 12:22:53:785 [9920] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - starting
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckRestart - end
May 19 12:22:53:785 [9920] cluster: MapResourceGroups(): - OUT
May 19 12:22:53:785 [9920] cluster: doWork - check my resource groups
May 19 12:22:53:785 [9920] cluster: CheckMyResourceGroups(): - IN
May 19 12:22:53:785 [9920] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:22:53:785 [9920] cluster: CheckResourceGroup(): - IN
May 19 12:22:53:785 [9920] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:53:785 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:785 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup(): - OUT
May 19 12:22:53:786 [9920] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup(): - IN
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:22:53:786 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:786 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup(): - OUT
May 19 12:22:53:787 [9920] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup(): - IN
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:22:53:787 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:787 [9920] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:788 [9920] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:22:53:788 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:788 [9920] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:22:53:788 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:788 [9920] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:22:53:788 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:788 [9920] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource(): - IN
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:22:53:789 [9920] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup(): - OUT
May 19 12:22:53:789 [9920] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup(): - IN
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup(): - OUT
May 19 12:22:53:789 [9920] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup(): - IN
May 19 12:22:53:789 [9920] cluster: CheckResourceGroup(): - OUT
May 19 12:22:53:789 [9920] cluster: CheckConfigVersionPds(): - IN
May 19 12:22:53:789 [9920] cluster: PdsSectionMD5(): - IN
May 19 12:22:53:789 [9920] cluster: PdsFromSection(): - IN
May 19 12:22:53:790 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:790 [9920] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:22:53:790 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:790 [9920] cluster: PdsFromSection(): - OUT
May 19 12:22:53:790 [9920] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:22:53:790 [9920] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:22:53:790 [9920] cluster: PdsSectionMD5(): - OUT
May 19 12:22:53:790 [9920] cluster: PdsSectionMD5(): - IN
May 19 12:22:53:790 [9920] cluster: PdsFromSection(): - IN
May 19 12:22:53:790 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:790 [9920] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:22:53:790 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:790 [9920] cluster: PdsFromSection(): - OUT
May 19 12:22:53:790 [9920] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:22:53:790 [9920] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:22:53:790 [9920] cluster: PdsSectionMD5(): - OUT
May 19 12:22:53:790 [9920] cluster: PdsSectionMD5(): - IN
May 19 12:22:53:790 [9920] cluster: PdsFromSection(): - IN
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:791 [9920] cluster: PdsFromSection(): - OUT
May 19 12:22:53:791 [9920] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:22:53:791 [9920] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:22:53:791 [9920] cluster: PdsSectionMD5(): - OUT
May 19 12:22:53:791 [9920] cluster: PdsSectionMD5(): - IN
May 19 12:22:53:791 [9920] cluster: PdsFromSection(): - IN
May 19 12:22:53:792 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:792 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:22:53:792 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:792 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:22:53:792 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:792 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:792 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:22:53:792 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:792 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:792 [9920] cluster: PdsFromSection(): - OUT
May 19 12:22:53:792 [9920] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:22:53:792 [9920] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:22:53:792 [9920] cluster: PdsSectionMD5(): - OUT
May 19 12:22:53:792 [9920] cluster: PdsSectionMD5(): - IN
May 19 12:22:53:792 [9920] cluster: PdsFromSection(): - IN
May 19 12:22:53:792 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:792 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:22:53:793 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:793 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:22:53:793 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:793 [9920] cluster: recursive_section2pds(): - IN
May 19 12:22:53:793 [9920] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:22:53:793 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:793 [9920] cluster: recursive_section2pds(): - OUT
May 19 12:22:53:793 [9920] cluster: PdsFromSection(): - OUT
May 19 12:22:53:793 [9920] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:22:53:793 [9920] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:22:53:793 [9920] cluster: PdsSectionMD5(): - OUT
May 19 12:22:53:793 [9920] cluster: CheckConfigVersionPds(): - OUT
May 19 12:22:53:793 [9920] cluster: CheckMyResourceGroups(): - OUT
May 19 12:22:53:793 [9920] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:54:533 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:55:534 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:55:763 [8520] cluster: (Main)update node & group conf is starting in thread 17992
May 19 12:22:55:763 [8520] cluster: main - adding Sleep 10
May 19 12:22:55:763 [17992] cluster: doWork(): - IN
May 19 12:22:55:763 [17992] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:56:535 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:57:535 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:57:765 [8520] cluster: (Main)update node & group conf is starting in thread 15056
May 19 12:22:57:765 [8520] cluster: main - adding Sleep 10
May 19 12:22:57:765 [15056] cluster: doWork(): - IN
May 19 12:22:57:765 [15056] cluster: node_state_resgroup_thread(): - OUT
May 19 12:22:58:536 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:59:531 [16744] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:22:59:531 [16744] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:22:59:531 [16744] cluster: (updateGroupConf) - Finished!
May 19 12:22:59:531 [16744] cluster: updateGroupConf(): - OUT
May 19 12:22:59:531 [16744] cluster:  (update_node_group_conf_thread) Releasing gRestartCallbackLock 
May 19 12:22:59:537 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:22:59:766 [8520] cluster: (Main)update node & group conf is starting in thread 19260
May 19 12:22:59:766 [8520] cluster: main - adding Sleep 10
May 19 12:22:59:766 [19260] cluster: doWork(): - IN
May 19 12:22:59:766 [19260] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:00:538 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:01:539 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:01:768 [8520] cluster: (Main)update node & group conf is starting in thread 5292
May 19 12:23:01:768 [8520] cluster: main - adding Sleep 10
May 19 12:23:01:768 [5292] cluster: doWork(): - IN
May 19 12:23:01:768 [5292] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:02:540 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:03:541 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:03:770 [8520] cluster: (Main)update node & group conf is starting in thread 21376
May 19 12:23:03:770 [8520] cluster: main - adding Sleep 10
May 19 12:23:03:770 [21376] cluster: doWork(): - IN
May 19 12:23:03:770 [21376] cluster: doWork - check groups
May 19 12:23:03:770 [21376] cluster: MapResourceGroups(): - IN
May 19 12:23:03:770 [21376] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:03:792 [21376] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:03:792 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:03:792 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:03:792 [21376] cluster: FindNode() End - OUT
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:03:792 [21376] cluster: FindGroup(): - IN
May 19 12:23:03:792 [21376] cluster: FindGroup(): - OUT
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - pds Deleted
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:03:792 [21376] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:03:792 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:03:792 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:03:792 [21376] cluster: FindNode() End - OUT
May 19 12:23:03:792 [21376] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:03:792 [21376] cluster: FindGroup(): - IN
May 19 12:23:03:792 [21376] cluster: FindGroup(): - OUT
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - pds Deleted
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:03:793 [21376] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:03:793 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:03:793 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:03:793 [21376] cluster: FindNode() End - OUT
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:03:793 [21376] cluster: FindGroup(): - IN
May 19 12:23:03:793 [21376] cluster: FindGroup(): - OUT
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - pds Deleted
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:03:793 [21376] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:03:793 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:03:793 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:03:793 [21376] cluster: FindNode() End - OUT
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:03:793 [21376] cluster: FindGroup(): - IN
May 19 12:23:03:793 [21376] cluster: FindGroup(): - OUT
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - pds Deleted
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:03:793 [21376] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:03:793 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:03:793 [21376] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:03:793 [21376] cluster: FindNode() End - OUT
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:03:793 [21376] cluster: FindGroup(): - IN
May 19 12:23:03:793 [21376] cluster: FindGroup(): - OUT
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - pds Deleted
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:03:793 [21376] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:03:793 [21376] cluster: ProbeInfoCheckRestart - end
May 19 12:23:03:794 [21376] cluster: MapResourceGroups(): - OUT
May 19 12:23:03:794 [21376] cluster: doWork - check my resource groups
May 19 12:23:03:794 [21376] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:03:794 [21376] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup(): - IN
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup(): - OUT
May 19 12:23:03:794 [21376] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup(): - IN
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:03:794 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:03:794 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup(): - OUT
May 19 12:23:03:795 [21376] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup(): - IN
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:03:795 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:795 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:796 [21376] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:03:796 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:796 [21376] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:03:796 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:796 [21376] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:03:796 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:796 [21376] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:797 [21376] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:03:797 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:797 [21376] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:03:797 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:797 [21376] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:03:797 [21376] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:03:797 [21376] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:03:798 [21376] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:03:798 [21376] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:798 [21376] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:03:798 [21376] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:03:798 [21376] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:03:798 [21376] cluster: CheckResourceGroup(): - OUT
May 19 12:23:03:798 [21376] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:03:798 [21376] cluster: CheckResourceGroup(): - IN
May 19 12:23:03:798 [21376] cluster: CheckResourceGroup(): - OUT
May 19 12:23:03:798 [21376] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:03:798 [21376] cluster: CheckResourceGroup(): - IN
May 19 12:23:03:798 [21376] cluster: CheckResourceGroup(): - OUT
May 19 12:23:03:798 [21376] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:03:798 [21376] cluster: PdsSectionMD5(): - IN
May 19 12:23:03:798 [21376] cluster: PdsFromSection(): - IN
May 19 12:23:03:798 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:798 [21376] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:03:798 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:798 [21376] cluster: PdsFromSection(): - OUT
May 19 12:23:03:798 [21376] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:03:798 [21376] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:03:798 [21376] cluster: PdsSectionMD5(): - OUT
May 19 12:23:03:798 [21376] cluster: PdsSectionMD5(): - IN
May 19 12:23:03:798 [21376] cluster: PdsFromSection(): - IN
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:799 [21376] cluster: PdsFromSection(): - OUT
May 19 12:23:03:799 [21376] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:03:799 [21376] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:03:799 [21376] cluster: PdsSectionMD5(): - OUT
May 19 12:23:03:799 [21376] cluster: PdsSectionMD5(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection(): - IN
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:799 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:799 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:800 [21376] cluster: PdsFromSection(): - OUT
May 19 12:23:03:800 [21376] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:03:800 [21376] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:03:800 [21376] cluster: PdsSectionMD5(): - OUT
May 19 12:23:03:800 [21376] cluster: PdsSectionMD5(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection(): - IN
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:800 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:800 [21376] cluster: PdsFromSection(): - OUT
May 19 12:23:03:800 [21376] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:03:800 [21376] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:03:800 [21376] cluster: PdsSectionMD5(): - OUT
May 19 12:23:03:800 [21376] cluster: PdsSectionMD5(): - IN
May 19 12:23:03:800 [21376] cluster: PdsFromSection(): - IN
May 19 12:23:03:801 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:801 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:03:801 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:801 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:03:801 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:801 [21376] cluster: recursive_section2pds(): - IN
May 19 12:23:03:801 [21376] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:03:801 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:801 [21376] cluster: recursive_section2pds(): - OUT
May 19 12:23:03:801 [21376] cluster: PdsFromSection(): - OUT
May 19 12:23:03:801 [21376] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:03:801 [21376] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:03:801 [21376] cluster: PdsSectionMD5(): - OUT
May 19 12:23:03:801 [21376] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:03:801 [21376] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:03:801 [21376] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:04:541 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:05:542 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:05:771 [8520] cluster: (Main)update node & group conf is starting in thread 17344
May 19 12:23:05:771 [8520] cluster: main - adding Sleep 10
May 19 12:23:05:771 [17344] cluster: doWork(): - IN
May 19 12:23:05:771 [17344] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:06:543 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:07:543 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:07:772 [8520] cluster: (Main)update node & group conf is starting in thread 15392
May 19 12:23:07:772 [8520] cluster: main - adding Sleep 10
May 19 12:23:07:772 [15392] cluster: doWork(): - IN
May 19 12:23:07:772 [15392] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:08:544 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:09:544 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:09:774 [8520] cluster: (Main)update node & group conf is starting in thread 18824
May 19 12:23:09:774 [8520] cluster: main - adding Sleep 10
May 19 12:23:09:774 [18824] cluster: doWork(): - IN
May 19 12:23:09:774 [18824] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:10:545 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:11:546 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:11:775 [8520] cluster: (Main)update node & group conf is starting in thread 17720
May 19 12:23:11:775 [8520] cluster: main - adding Sleep 10
May 19 12:23:11:775 [17720] cluster: doWork(): - IN
May 19 12:23:11:775 [17720] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:12:547 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:13:548 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:13:777 [8520] cluster: (Main)update node & group conf is starting in thread 8012
May 19 12:23:13:777 [8520] cluster: main - adding Sleep 10
May 19 12:23:13:777 [8012] cluster: doWork(): - IN
May 19 12:23:13:777 [8012] cluster: doWork - check groups
May 19 12:23:13:777 [8012] cluster: MapResourceGroups(): - IN
May 19 12:23:13:777 [8012] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:13:804 [8012] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:13:804 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:13:804 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:13:804 [8012] cluster: FindNode() End - OUT
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:13:804 [8012] cluster: FindGroup(): - IN
May 19 12:23:13:804 [8012] cluster: FindGroup(): - OUT
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - pds Deleted
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:13:804 [8012] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:13:804 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:13:804 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:13:804 [8012] cluster: FindNode() End - OUT
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:13:804 [8012] cluster: FindGroup(): - IN
May 19 12:23:13:804 [8012] cluster: FindGroup(): - OUT
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - pds Deleted
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:13:804 [8012] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:13:805 [8012] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:13:805 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:13:805 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:13:805 [8012] cluster: FindNode() End - OUT
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:13:805 [8012] cluster: FindGroup(): - IN
May 19 12:23:13:805 [8012] cluster: FindGroup(): - OUT
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - pds Deleted
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:13:805 [8012] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:13:805 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:13:805 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:13:805 [8012] cluster: FindNode() End - OUT
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:13:805 [8012] cluster: FindGroup(): - IN
May 19 12:23:13:805 [8012] cluster: FindGroup(): - OUT
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - pds Deleted
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:13:805 [8012] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:13:805 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:13:805 [8012] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:13:805 [8012] cluster: FindNode() End - OUT
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:13:805 [8012] cluster: FindGroup(): - IN
May 19 12:23:13:805 [8012] cluster: FindGroup(): - OUT
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - pds Deleted
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:13:805 [8012] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:13:805 [8012] cluster: ProbeInfoCheckRestart - end
May 19 12:23:13:805 [8012] cluster: MapResourceGroups(): - OUT
May 19 12:23:13:805 [8012] cluster: doWork - check my resource groups
May 19 12:23:13:805 [8012] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:13:805 [8012] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:13:805 [8012] cluster: CheckResourceGroup(): - IN
May 19 12:23:13:805 [8012] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:13:806 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:806 [8012] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:13:806 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:806 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:806 [8012] cluster: CheckResourceGroup(): - OUT
May 19 12:23:13:806 [8012] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:13:806 [8012] cluster: CheckResourceGroup(): - IN
May 19 12:23:13:806 [8012] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:13:807 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:807 [8012] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:13:807 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:807 [8012] cluster: CheckResourceGroup(): - OUT
May 19 12:23:13:807 [8012] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:13:807 [8012] cluster: CheckResourceGroup(): - IN
May 19 12:23:13:807 [8012] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:13:807 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:807 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:808 [8012] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:13:808 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:808 [8012] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:13:808 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:808 [8012] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:809 [8012] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:13:809 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:809 [8012] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:13:809 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:809 [8012] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:13:809 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:809 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:810 [8012] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:13:810 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:810 [8012] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:13:810 [8012] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:13:810 [8012] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:13:811 [8012] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:13:811 [8012] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:811 [8012] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:13:811 [8012] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:13:811 [8012] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:13:811 [8012] cluster: CheckResourceGroup(): - OUT
May 19 12:23:13:811 [8012] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:13:811 [8012] cluster: CheckResourceGroup(): - IN
May 19 12:23:13:811 [8012] cluster: CheckResourceGroup(): - OUT
May 19 12:23:13:811 [8012] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:13:811 [8012] cluster: CheckResourceGroup(): - IN
May 19 12:23:13:811 [8012] cluster: CheckResourceGroup(): - OUT
May 19 12:23:13:811 [8012] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:13:811 [8012] cluster: PdsSectionMD5(): - IN
May 19 12:23:13:811 [8012] cluster: PdsFromSection(): - IN
May 19 12:23:13:811 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:811 [8012] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:13:811 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:811 [8012] cluster: PdsFromSection(): - OUT
May 19 12:23:13:811 [8012] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:13:811 [8012] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:13:811 [8012] cluster: PdsSectionMD5(): - OUT
May 19 12:23:13:811 [8012] cluster: PdsSectionMD5(): - IN
May 19 12:23:13:811 [8012] cluster: PdsFromSection(): - IN
May 19 12:23:13:812 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:812 [8012] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:13:812 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:812 [8012] cluster: PdsFromSection(): - OUT
May 19 12:23:13:812 [8012] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:13:812 [8012] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:13:812 [8012] cluster: PdsSectionMD5(): - OUT
May 19 12:23:13:812 [8012] cluster: PdsSectionMD5(): - IN
May 19 12:23:13:812 [8012] cluster: PdsFromSection(): - IN
May 19 12:23:13:812 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:812 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:813 [8012] cluster: PdsFromSection(): - OUT
May 19 12:23:13:813 [8012] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:13:813 [8012] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:13:813 [8012] cluster: PdsSectionMD5(): - OUT
May 19 12:23:13:813 [8012] cluster: PdsSectionMD5(): - IN
May 19 12:23:13:813 [8012] cluster: PdsFromSection(): - IN
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:814 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:814 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:814 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:814 [8012] cluster: PdsFromSection(): - OUT
May 19 12:23:13:814 [8012] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:13:814 [8012] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:13:814 [8012] cluster: PdsSectionMD5(): - OUT
May 19 12:23:13:814 [8012] cluster: PdsSectionMD5(): - IN
May 19 12:23:13:814 [8012] cluster: PdsFromSection(): - IN
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:814 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:814 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - IN
May 19 12:23:13:814 [8012] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:814 [8012] cluster: recursive_section2pds(): - OUT
May 19 12:23:13:814 [8012] cluster: PdsFromSection(): - OUT
May 19 12:23:13:814 [8012] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:13:814 [8012] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:13:814 [8012] cluster: PdsSectionMD5(): - OUT
May 19 12:23:13:814 [8012] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:13:814 [8012] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:13:814 [8012] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:14:549 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:15:549 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:15:779 [8520] cluster: (Main)update node & group conf is starting in thread 15208
May 19 12:23:15:779 [8520] cluster: main - adding Sleep 10
May 19 12:23:15:779 [15208] cluster: doWork(): - IN
May 19 12:23:15:779 [15208] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:16:550 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:17:551 [20420] cluster: update node & group conf is starting in thread 13480
May 19 12:23:17:551 [13480] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:23:17:551 [13480] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:23:17:551 [13480] cluster: child udp_thread
May 19 12:23:17:551 [13480] cluster: child udp - Update node configs
May 19 12:23:17:551 [13480] cluster: updateNodeConf(): - IN
May 19 12:23:17:551 [13480] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:23:17:551 [13480] cluster: NodeConfigurationRequest(): - IN
May 19 12:23:17:551 [13480] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:23:17:551 [13480] cluster: PdsFromSection(): - IN
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster size=74
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - IN
May 19 12:23:17:552 [13480] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: recursive_section2pds(): - OUT
May 19 12:23:17:552 [13480] cluster: PdsFromSection(): - OUT
May 19 12:23:17:552 [13480] cluster: NodeConfigurationRequest(): - OUT
May 19 12:23:17:552 [13480] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:23:17:780 [8520] cluster: (Main)update node & group conf is starting in thread 20152
May 19 12:23:17:780 [8520] cluster: main - adding Sleep 10
May 19 12:23:17:780 [20152] cluster: doWork(): - IN
May 19 12:23:17:780 [20152] cluster: doWork - check nodes - do connection
May 19 12:23:17:780 [20152] cluster: ConnectAllNodes(): - IN
May 19 12:23:17:780 [20152] cluster: (ConnectAllNodes) - Start
May 19 12:23:17:780 [20152] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:23:17:780 [20152] cluster: ConnectToNode(): - IN
May 19 12:23:17:780 [20152] cluster: controller port is 48000
May 19 12:23:18:536 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:18:536 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56599  h=298 d=1417
May 19 12:23:18:536 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:23:18:536 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:23:18:536 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:23:18:536 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:23:18:536 [20420] cluster: set_node_version - from 10.27.163.134/56599 [0x10150e0]
May 19 12:23:18:536 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:23:18:536 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:23:18:536 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56599
May 19 12:23:18:536 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:23:18:536 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:23:18:536 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:23:18:537 [20420] cluster: RREQUEST: _close <-10.27.163.134/56599  h=287 d=0
May 19 12:23:18:537 [20420] cluster: sockClose:00000000010150E0:10.27.163.135/48003
May 19 12:23:18:537 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56600  h=299 d=866
May 19 12:23:18:538 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:23:18:538 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:23:18:538 [20420] cluster: set_group_version - from 10.27.163.134/56600 [0x10150e0]
May 19 12:23:18:538 [20420] cluster: set_group_version - pds received, size=866
May 19 12:23:18:538 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:23:18:538 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:23:18:538 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:23:18:538 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:18:538 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:18:538 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:23:18:538 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:23:18:538 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:23:18:538 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:23:18:538 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:23:18:538 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:23:18:538 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:23:18:538 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56600
May 19 12:23:18:538 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:23:18:538 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:23:18:538 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:23:18:539 [20420] cluster: RREQUEST: _close <-10.27.163.134/56600  h=287 d=0
May 19 12:23:18:539 [20420] cluster: sockClose:00000000010150E0:10.27.163.135/48003
May 19 12:23:19:540 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:19:781 [8520] cluster: main - adding Sleep 10
May 19 12:23:20:541 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:21:541 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:21:783 [8520] cluster: main - adding Sleep 10
May 19 12:23:22:542 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:22:780 [20152] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:23:22:780 [20152] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:23:22:780 [20152] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:23:22:780 [20152] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:23:22:780 [20152] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:23:22:780 [20152] cluster: ConnectAllNodes(): - OUT
May 19 12:23:22:780 [20152] cluster: Not connected to any nodes!
May 19 12:23:22:780 [20152] cluster: doWork - check nodes - state
May 19 12:23:22:780 [20152] cluster: CheckNodeState(): - Starting IN
May 19 12:23:22:785 [20152] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:22:785 [20152] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:22:785 [20152] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:22:785 [20152] cluster: FindNode() End - OUT
May 19 12:23:22:786 [20152] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:23:22:786 [20152] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:23:22:786 [20152] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:22:786 [20152] cluster: FindNode() End - OUT
May 19 12:23:22:786 [20152] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:23:22:786 [20152] cluster: CheckNodeState(): - OUT
May 19 12:23:22:786 [20152] cluster: doWork - check nodes - any new probes installed
May 19 12:23:22:786 [20152] cluster: ProbeInfoCheck(): - IN
May 19 12:23:22:786 [20152] cluster: ProbeInfoCheck(): - OUT
May 19 12:23:22:786 [20152] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:23:543 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:23:784 [8520] cluster: (Main)update node & group conf is starting in thread 16716
May 19 12:23:23:784 [8520] cluster: main - adding Sleep 10
May 19 12:23:23:784 [16716] cluster: doWork(): - IN
May 19 12:23:23:784 [16716] cluster: doWork - check groups
May 19 12:23:23:784 [16716] cluster: MapResourceGroups(): - IN
May 19 12:23:23:784 [16716] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:23:810 [16716] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:23:810 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:23:810 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:23:810 [16716] cluster: FindNode() End - OUT
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:23:810 [16716] cluster: FindGroup(): - IN
May 19 12:23:23:810 [16716] cluster: FindGroup(): - OUT
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - pds Deleted
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:23:810 [16716] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:23:810 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:23:810 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:23:810 [16716] cluster: FindNode() End - OUT
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:23:810 [16716] cluster: FindGroup(): - IN
May 19 12:23:23:810 [16716] cluster: FindGroup(): - OUT
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - pds Deleted
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:23:810 [16716] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:23:810 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:23:810 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:23:810 [16716] cluster: FindNode() End - OUT
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:23:810 [16716] cluster: FindGroup(): - IN
May 19 12:23:23:810 [16716] cluster: FindGroup(): - OUT
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - pds Deleted
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:23:810 [16716] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:23:811 [16716] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:23:811 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:23:811 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:23:811 [16716] cluster: FindNode() End - OUT
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:23:811 [16716] cluster: FindGroup(): - IN
May 19 12:23:23:811 [16716] cluster: FindGroup(): - OUT
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - pds Deleted
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:23:811 [16716] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:23:811 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:23:811 [16716] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:23:811 [16716] cluster: FindNode() End - OUT
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:23:811 [16716] cluster: FindGroup(): - IN
May 19 12:23:23:811 [16716] cluster: FindGroup(): - OUT
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - pds Deleted
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:23:811 [16716] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckRestart - end
May 19 12:23:23:811 [16716] cluster: MapResourceGroups(): - OUT
May 19 12:23:23:811 [16716] cluster: doWork - check my resource groups
May 19 12:23:23:811 [16716] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:23:811 [16716] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:23:811 [16716] cluster: CheckResourceGroup(): - IN
May 19 12:23:23:811 [16716] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:23:811 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:811 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:812 [16716] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:23:812 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:812 [16716] cluster: CheckResourceGroup(): - OUT
May 19 12:23:23:812 [16716] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:23:812 [16716] cluster: CheckResourceGroup(): - IN
May 19 12:23:23:812 [16716] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:23:812 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:812 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup(): - OUT
May 19 12:23:23:813 [16716] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup(): - IN
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:23:813 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:813 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:814 [16716] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:23:814 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:814 [16716] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:23:814 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:814 [16716] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:23:814 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:814 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:815 [16716] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:23:815 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:815 [16716] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:23:815 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:815 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:816 [16716] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:23:816 [16716] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:23:816 [16716] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:23:816 [16716] cluster: CheckResourceGroup(): - OUT
May 19 12:23:23:816 [16716] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:23:816 [16716] cluster: CheckResourceGroup(): - IN
May 19 12:23:23:816 [16716] cluster: CheckResourceGroup(): - OUT
May 19 12:23:23:816 [16716] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:23:816 [16716] cluster: CheckResourceGroup(): - IN
May 19 12:23:23:816 [16716] cluster: CheckResourceGroup(): - OUT
May 19 12:23:23:816 [16716] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:23:816 [16716] cluster: PdsSectionMD5(): - IN
May 19 12:23:23:816 [16716] cluster: PdsFromSection(): - IN
May 19 12:23:23:817 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:817 [16716] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:23:817 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:817 [16716] cluster: PdsFromSection(): - OUT
May 19 12:23:23:817 [16716] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:23:817 [16716] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:23:817 [16716] cluster: PdsSectionMD5(): - OUT
May 19 12:23:23:817 [16716] cluster: PdsSectionMD5(): - IN
May 19 12:23:23:817 [16716] cluster: PdsFromSection(): - IN
May 19 12:23:23:817 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:817 [16716] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:23:817 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:817 [16716] cluster: PdsFromSection(): - OUT
May 19 12:23:23:817 [16716] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:23:817 [16716] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:23:817 [16716] cluster: PdsSectionMD5(): - OUT
May 19 12:23:23:817 [16716] cluster: PdsSectionMD5(): - IN
May 19 12:23:23:817 [16716] cluster: PdsFromSection(): - IN
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:818 [16716] cluster: PdsFromSection(): - OUT
May 19 12:23:23:818 [16716] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:23:818 [16716] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:23:818 [16716] cluster: PdsSectionMD5(): - OUT
May 19 12:23:23:818 [16716] cluster: PdsSectionMD5(): - IN
May 19 12:23:23:818 [16716] cluster: PdsFromSection(): - IN
May 19 12:23:23:819 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:819 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:23:819 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:819 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:23:819 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:819 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:819 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:23:819 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:819 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:819 [16716] cluster: PdsFromSection(): - OUT
May 19 12:23:23:819 [16716] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:23:819 [16716] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:23:819 [16716] cluster: PdsSectionMD5(): - OUT
May 19 12:23:23:819 [16716] cluster: PdsSectionMD5(): - IN
May 19 12:23:23:819 [16716] cluster: PdsFromSection(): - IN
May 19 12:23:23:820 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:820 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:23:820 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:820 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:23:820 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:820 [16716] cluster: recursive_section2pds(): - IN
May 19 12:23:23:820 [16716] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:23:820 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:820 [16716] cluster: recursive_section2pds(): - OUT
May 19 12:23:23:820 [16716] cluster: PdsFromSection(): - OUT
May 19 12:23:23:820 [16716] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:23:820 [16716] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:23:820 [16716] cluster: PdsSectionMD5(): - OUT
May 19 12:23:23:820 [16716] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:23:820 [16716] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:23:820 [16716] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:24:544 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:25:545 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:25:786 [8520] cluster: (Main)update node & group conf is starting in thread 20400
May 19 12:23:25:786 [8520] cluster: main - adding Sleep 10
May 19 12:23:25:786 [20400] cluster: doWork(): - IN
May 19 12:23:25:786 [20400] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:26:546 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:27:546 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:27:788 [8520] cluster: (Main)update node & group conf is starting in thread 9312
May 19 12:23:27:788 [8520] cluster: main - adding Sleep 10
May 19 12:23:27:788 [9312] cluster: doWork(): - IN
May 19 12:23:27:788 [9312] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:28:547 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:29:548 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:29:789 [8520] cluster: (Main)update node & group conf is starting in thread 17784
May 19 12:23:29:789 [8520] cluster: main - adding Sleep 10
May 19 12:23:29:789 [17784] cluster: doWork(): - IN
May 19 12:23:29:789 [17784] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:30:549 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:30:627 [8520] cluster: RREQUEST: set_node_up <-10.27.163.134/56605  h=293 d=106
May 19 12:23:30:627 [8520] cluster: nimSockaddr2Ip - found 10.27.163.134
May 19 12:23:30:627 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:23:30:632 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:23:30:632 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:23:30:632 [8520] cluster:  data   time=1589883810 access=2 ident=31352
May 19 12:23:30:632 [8520] cluster: sockClose:00000000010165A0:10.27.163.135/56366
May 19 12:23:30:632 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:23:30:632 [8520] cluster: cmd_set_node_up(): - IN
May 19 12:23:30:632 [8520] cluster: set_node_up - from 10.27.163.134/56605 [0x10150e0]
May 19 12:23:30:632 [8520] cluster: cmd_set_node_up(): - OUT
May 19 12:23:30:632 [8048] cluster: thrSetNodeUp(): - IN
May 19 12:23:30:632 [8048] cluster:  (thrSetNodeUp) Waiting gthreadCallbackLock 
May 19 12:23:30:632 [8048] cluster:  (thrSetNodeUp) Locking gthreadCallbackLock 
May 19 12:23:30:632 [8048] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:23:30:632 [8048] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:30:632 [8048] cluster: FindNode() End - OUT
May 19 12:23:30:632 [8048] cluster: thrSetNodeUp - Caller address: /TotalDxim/SDCPPDXIM07/frhdstd-apbct01/cluster, My adress: 10.27.163.135
May 19 12:23:30:632 [8048] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56605
May 19 12:23:30:633 [8048] cluster:  head   mtype=200 status=0 seq=0
May 19 12:23:30:633 [8048] cluster: sockClose:00000000010150E0:10.27.163.135/48008
May 19 12:23:30:633 [8048] cluster: SREQUEST: _close ->10.27.163.134/56605
May 19 12:23:30:633 [8048] cluster:  (thrSetNodeUp) Releasing gthreadCallbackLock 
May 19 12:23:30:633 [8048] cluster: thrSetNodeUp(): - OUT
May 19 12:23:31:550 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:31:633 [8520] cluster: (Main)update node & group conf is starting in thread 11880
May 19 12:23:31:633 [8520] cluster: main - adding Sleep 10
May 19 12:23:31:633 [11880] cluster: doWork(): - IN
May 19 12:23:31:633 [11880] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:32:551 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:33:552 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:33:635 [8520] cluster: (Main)update node & group conf is starting in thread 6652
May 19 12:23:33:635 [8520] cluster: main - adding Sleep 10
May 19 12:23:33:635 [6652] cluster: doWork(): - IN
May 19 12:23:33:635 [6652] cluster: doWork - check groups
May 19 12:23:33:635 [6652] cluster: MapResourceGroups(): - IN
May 19 12:23:33:635 [6652] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:33:657 [6652] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:33:635 [6652] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:33:657 [6652] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:33:657 [6652] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:33:657 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:33:657 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:33:657 [6652] cluster: FindNode() End - OUT
May 19 12:23:33:657 [6652] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:33:658 [6652] cluster: FindGroup(): - IN
May 19 12:23:33:658 [6652] cluster: FindGroup(): - OUT
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - pds Deleted
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:33:658 [6652] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:33:658 [6652] cluster: FindNode() End - OUT
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:33:658 [6652] cluster: FindGroup(): - IN
May 19 12:23:33:658 [6652] cluster: FindGroup(): - OUT
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - pds Deleted
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:33:658 [6652] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:33:658 [6652] cluster: FindNode() End - OUT
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:33:658 [6652] cluster: FindGroup(): - IN
May 19 12:23:33:658 [6652] cluster: FindGroup(): - OUT
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - pds Deleted
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:33:658 [6652] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:33:658 [6652] cluster: FindNode() End - OUT
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:33:658 [6652] cluster: FindGroup(): - IN
May 19 12:23:33:658 [6652] cluster: FindGroup(): - OUT
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - pds Deleted
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:23:33:658 [6652] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:33:658 [6652] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:33:658 [6652] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:33:658 [6652] cluster: FindNode() End - OUT
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:33:659 [6652] cluster: FindGroup(): - IN
May 19 12:23:33:659 [6652] cluster: FindGroup(): - OUT
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - pds Deleted
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:33:659 [6652] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckRestart - end
May 19 12:23:33:659 [6652] cluster: MapResourceGroups(): - OUT
May 19 12:23:33:659 [6652] cluster: doWork - check my resource groups
May 19 12:23:33:659 [6652] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:33:659 [6652] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:33:659 [6652] cluster: CheckResourceGroup(): - IN
May 19 12:23:33:659 [6652] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:33:659 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:659 [6652] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:33:659 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:659 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup(): - OUT
May 19 12:23:33:660 [6652] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup(): - IN
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup(): - OUT
May 19 12:23:33:660 [6652] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup(): - IN
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:33:660 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:660 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:661 [6652] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:33:661 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:661 [6652] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:33:661 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:661 [6652] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:33:661 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:661 [6652] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:662 [6652] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:33:662 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:662 [6652] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:33:662 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:662 [6652] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:33:662 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:662 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:663 [6652] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:33:663 [6652] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:33:663 [6652] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:33:663 [6652] cluster: CheckResourceGroup(): - OUT
May 19 12:23:33:663 [6652] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:33:663 [6652] cluster: CheckResourceGroup(): - IN
May 19 12:23:33:663 [6652] cluster: CheckResourceGroup(): - OUT
May 19 12:23:33:663 [6652] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:33:663 [6652] cluster: CheckResourceGroup(): - IN
May 19 12:23:33:663 [6652] cluster: CheckResourceGroup(): - OUT
May 19 12:23:33:663 [6652] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:33:663 [6652] cluster: PdsSectionMD5(): - IN
May 19 12:23:33:663 [6652] cluster: PdsFromSection(): - IN
May 19 12:23:33:663 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:663 [6652] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:33:663 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:664 [6652] cluster: PdsFromSection(): - OUT
May 19 12:23:33:664 [6652] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:33:664 [6652] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:33:664 [6652] cluster: PdsSectionMD5(): - OUT
May 19 12:23:33:664 [6652] cluster: PdsSectionMD5(): - IN
May 19 12:23:33:664 [6652] cluster: PdsFromSection(): - IN
May 19 12:23:33:664 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:664 [6652] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:33:664 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:664 [6652] cluster: PdsFromSection(): - OUT
May 19 12:23:33:664 [6652] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:33:664 [6652] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:33:664 [6652] cluster: PdsSectionMD5(): - OUT
May 19 12:23:33:664 [6652] cluster: PdsSectionMD5(): - IN
May 19 12:23:33:664 [6652] cluster: PdsFromSection(): - IN
May 19 12:23:33:664 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:665 [6652] cluster: PdsFromSection(): - OUT
May 19 12:23:33:665 [6652] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:33:665 [6652] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:33:665 [6652] cluster: PdsSectionMD5(): - OUT
May 19 12:23:33:665 [6652] cluster: PdsSectionMD5(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection(): - IN
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:665 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:33:665 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:666 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:666 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:666 [6652] cluster: PdsFromSection(): - OUT
May 19 12:23:33:666 [6652] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:33:666 [6652] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:33:666 [6652] cluster: PdsSectionMD5(): - OUT
May 19 12:23:33:666 [6652] cluster: PdsSectionMD5(): - IN
May 19 12:23:33:666 [6652] cluster: PdsFromSection(): - IN
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:666 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:666 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - IN
May 19 12:23:33:666 [6652] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:666 [6652] cluster: recursive_section2pds(): - OUT
May 19 12:23:33:666 [6652] cluster: PdsFromSection(): - OUT
May 19 12:23:33:666 [6652] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:33:666 [6652] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:33:666 [6652] cluster: PdsSectionMD5(): - OUT
May 19 12:23:33:666 [6652] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:33:666 [6652] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:33:666 [6652] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:34:552 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:35:553 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:35:636 [8520] cluster: (Main)update node & group conf is starting in thread 10788
May 19 12:23:35:636 [8520] cluster: main - adding Sleep 10
May 19 12:23:35:636 [10788] cluster: doWork(): - IN
May 19 12:23:35:636 [10788] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:36:554 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:37:555 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:37:638 [8520] cluster: (Main)update node & group conf is starting in thread 9760
May 19 12:23:37:638 [8520] cluster: main - adding Sleep 10
May 19 12:23:37:638 [9760] cluster: doWork(): - IN
May 19 12:23:37:638 [9760] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:38:553 [13480] cluster: sockConnect - connect to  48003 failed 10060
May 19 12:23:38:553 [13480] cluster: (updateNodeConf) - Connect to ip/host: 10.30.10.16
May 19 12:23:38:553 [13480] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:23:38:553 [13480] cluster: updateNodeConf(): - OUT
May 19 12:23:38:553 [13480] cluster: child udp - Update group configs
May 19 12:23:38:553 [13480] cluster: updateGroupConf(): - IN
May 19 12:23:38:553 [13480] cluster: (updateGroupConf) - This node ip/host: 10.27.163.135
May 19 12:23:38:553 [13480] cluster: ResourceGroupConfigurationRequest(): - IN
May 19 12:23:38:553 [13480] cluster: ResourceGroupConfigurationRequest(): - OUT
May 19 12:23:38:553 [13480] cluster: (updateGroupConf) - Connect to ip/host: 10.30.10.16, port: 48003
May 19 12:23:38:556 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:39:557 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:39:640 [8520] cluster: (Main)update node & group conf is starting in thread 10116
May 19 12:23:39:640 [8520] cluster: main - adding Sleep 10
May 19 12:23:39:640 [10116] cluster: doWork(): - IN
May 19 12:23:39:640 [10116] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:40:557 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:41:558 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:41:641 [8520] cluster: (Main)update node & group conf is starting in thread 8388
May 19 12:23:41:641 [8520] cluster: main - adding Sleep 10
May 19 12:23:41:641 [8388] cluster: doWork(): - IN
May 19 12:23:41:641 [8388] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:42:559 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:43:559 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:43:643 [8520] cluster: (Main)update node & group conf is starting in thread 6264
May 19 12:23:43:643 [8520] cluster: main - adding Sleep 10
May 19 12:23:43:643 [6264] cluster: doWork(): - IN
May 19 12:23:43:643 [6264] cluster: doWork - check groups
May 19 12:23:43:643 [6264] cluster: MapResourceGroups(): - IN
May 19 12:23:43:643 [6264] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:43:672 [6264] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:43:672 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:43:672 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:43:672 [6264] cluster: FindNode() End - OUT
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:43:672 [6264] cluster: FindGroup(): - IN
May 19 12:23:43:672 [6264] cluster: FindGroup(): - OUT
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - pds Deleted
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:43:672 [6264] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:43:672 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:43:672 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:43:672 [6264] cluster: FindNode() End - OUT
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:43:672 [6264] cluster: FindGroup(): - IN
May 19 12:23:43:672 [6264] cluster: FindGroup(): - OUT
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - pds Deleted
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:23:43:672 [6264] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:43:672 [6264] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:43:672 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:43:672 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:43:673 [6264] cluster: FindNode() End - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:43:673 [6264] cluster: FindGroup(): - IN
May 19 12:23:43:673 [6264] cluster: FindGroup(): - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - pds Deleted
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:43:673 [6264] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:43:673 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:43:673 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:43:673 [6264] cluster: FindNode() End - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:43:673 [6264] cluster: FindGroup(): - IN
May 19 12:23:43:673 [6264] cluster: FindGroup(): - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - pds Deleted
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:43:673 [6264] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:43:673 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:43:673 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:43:673 [6264] cluster: FindNode() End - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:43:673 [6264] cluster: FindGroup(): - IN
May 19 12:23:43:673 [6264] cluster: FindGroup(): - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - pds Deleted
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - end
May 19 12:23:43:673 [6264] cluster: MapResourceGroups(): - OUT
May 19 12:23:43:673 [6264] cluster: doWork - check my resource groups
May 19 12:23:43:673 [6264] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:43:673 [6264] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:43:673 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:673 [6264] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:43:673 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:674 [6264] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:675 [6264] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:679 [6264] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:679 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:679 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:679 [6264] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:43:679 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:679 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:679 [6264] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:679 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:680 [6264] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:43:680 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:43:680 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:680 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:43:681 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:43:681 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:682 [6264] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:43:682 [6264] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:43:682 [6264] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:44:560 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:45:561 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:45:644 [8520] cluster: (Main)update node & group conf is starting in thread 6548
May 19 12:23:45:644 [8520] cluster: main - adding Sleep 10
May 19 12:23:45:644 [6548] cluster: doWork(): - IN
May 19 12:23:45:644 [6548] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:46:562 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:47:562 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:47:645 [8520] cluster: (Main)update node & group conf is starting in thread 9292
May 19 12:23:47:645 [8520] cluster: main - adding Sleep 10
May 19 12:23:47:645 [9292] cluster: doWork(): - IN
May 19 12:23:47:645 [9292] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:48:563 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:49:564 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:49:647 [8520] cluster: (Main)update node & group conf is starting in thread 8708
May 19 12:23:49:647 [8520] cluster: main - adding Sleep 10
May 19 12:23:49:647 [8708] cluster: doWork(): - IN
May 19 12:23:49:647 [8708] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:50:565 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:51:566 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:51:649 [8520] cluster: (Main)update node & group conf is starting in thread 6668
May 19 12:23:51:649 [8520] cluster: main - adding Sleep 10
May 19 12:23:51:649 [6668] cluster: doWork(): - IN
May 19 12:23:51:649 [6668] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:52:567 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:53:567 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:53:650 [8520] cluster: (Main)update node & group conf is starting in thread 16608
May 19 12:23:53:650 [8520] cluster: main - adding Sleep 10
May 19 12:23:53:650 [16608] cluster: doWork(): - IN
May 19 12:23:53:650 [16608] cluster: doWork - check groups
May 19 12:23:53:650 [16608] cluster: MapResourceGroups(): - IN
May 19 12:23:53:650 [16608] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:674 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:674 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:674 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:674 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:674 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:674 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:674 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:674 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:674 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:674 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:674 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:674 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:675 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:675 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:675 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:675 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:675 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:675 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:675 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:675 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - end
May 19 12:23:53:675 [16608] cluster: MapResourceGroups(): - OUT
May 19 12:23:53:675 [16608] cluster: doWork - check my resource groups
May 19 12:23:53:675 [16608] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:53:675 [16608] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:53:675 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:675 [16608] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:53:675 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:53:679 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:679 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:680 [16608] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:680 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:680 [16608] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:53:680 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:53:680 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:680 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:680 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:680 [16608] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:53:681 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:53:681 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:683 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:683 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:683 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:683 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:683 [16608] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:53:683 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:53:683 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:683 [16608] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:53:683 [16608] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:53:683 [16608] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:54:568 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:55:569 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:55:652 [8520] cluster: (Main)update node & group conf is starting in thread 10088
May 19 12:23:55:652 [8520] cluster: main - adding Sleep 10
May 19 12:23:55:652 [10088] cluster: doWork(): - IN
May 19 12:23:55:652 [10088] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:56:570 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:57:571 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:57:654 [8520] cluster: (Main)update node & group conf is starting in thread 22384
May 19 12:23:57:654 [8520] cluster: main - adding Sleep 10
May 19 12:23:57:654 [22384] cluster: doWork(): - IN
May 19 12:23:57:654 [22384] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:58:572 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:59:560 [13480] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:23:59:560 [13480] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:23:59:560 [13480] cluster: (updateGroupConf) - Finished!
May 19 12:23:59:560 [13480] cluster: updateGroupConf(): - OUT
May 19 12:23:59:560 [13480] cluster:  (update_node_group_conf_thread) Releasing gRestartCallbackLock 
May 19 12:23:59:572 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:59:656 [8520] cluster: (Main)update node & group conf is starting in thread 3688
May 19 12:23:59:656 [8520] cluster: main - adding Sleep 10
May 19 12:23:59:656 [3688] cluster: doWork(): - IN
May 19 12:23:59:656 [3688] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:00:573 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:01:574 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:01:657 [8520] cluster: (Main)update node & group conf is starting in thread 10228
May 19 12:24:01:657 [8520] cluster: main - adding Sleep 10
May 19 12:24:01:657 [10228] cluster: doWork(): - IN
May 19 12:24:01:657 [10228] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:02:575 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:03:576 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:03:659 [8520] cluster: (Main)update node & group conf is starting in thread 13016
May 19 12:24:03:659 [8520] cluster: main - adding Sleep 10
May 19 12:24:03:659 [13016] cluster: doWork(): - IN
May 19 12:24:03:659 [13016] cluster: doWork - check groups
May 19 12:24:03:659 [13016] cluster: MapResourceGroups(): - IN
May 19 12:24:03:659 [13016] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:03:679 [13016] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:679 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:679 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:679 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:681 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:681 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:681 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:681 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - end
May 19 12:24:03:681 [13016] cluster: MapResourceGroups(): - OUT
May 19 12:24:03:681 [13016] cluster: doWork - check my resource groups
May 19 12:24:03:681 [13016] cluster: CheckMyResourceGroups(): - IN
May 19 12:24:03:681 [13016] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckConfigVersionPds(): - IN
May 19 12:24:03:685 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:685 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:687 [13016] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:24:03:687 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:24:03:687 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:687 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:688 [13016] cluster: CheckConfigVersionPds(): - OUT
May 19 12:24:03:688 [13016] cluster: CheckMyResourceGroups(): - OUT
May 19 12:24:03:688 [13016] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:04:577 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:05:578 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:05:661 [8520] cluster: (Main)update node & group conf is starting in thread 15136
May 19 12:24:05:661 [8520] cluster: main - adding Sleep 10
May 19 12:24:05:661 [15136] cluster: doWork(): - IN
May 19 12:24:05:661 [15136] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:06:578 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:07:579 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:07:662 [8520] cluster: (Main)update node & group conf is starting in thread 16760
May 19 12:24:07:662 [8520] cluster: main - adding Sleep 10
May 19 12:24:07:662 [16760] cluster: doWork(): - IN
May 19 12:24:07:662 [16760] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:08:580 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:09:581 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:09:664 [8520] cluster: (Main)update node & group conf is starting in thread 3916
May 19 12:24:09:664 [8520] cluster: main - adding Sleep 10
May 19 12:24:09:664 [3916] cluster: doWork(): - IN
May 19 12:24:09:664 [3916] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:10:582 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:11:583 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:11:666 [8520] cluster: (Main)update node & group conf is starting in thread 14948
May 19 12:24:11:666 [8520] cluster: main - adding Sleep 10
May 19 12:24:11:666 [14948] cluster: doWork(): - IN
May 19 12:24:11:666 [14948] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:12:583 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:13:584 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:13:667 [8520] cluster: (Main)update node & group conf is starting in thread 16436
May 19 12:24:13:667 [8520] cluster: main - adding Sleep 10
May 19 12:24:13:667 [16436] cluster: doWork(): - IN
May 19 12:24:13:667 [16436] cluster: doWork - check groups
May 19 12:24:13:667 [16436] cluster: MapResourceGroups(): - IN
May 19 12:24:13:667 [16436] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:692 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:692 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:692 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:692 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:692 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:692 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:692 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:693 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:693 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:693 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - end
May 19 12:24:13:694 [16436] cluster: MapResourceGroups(): - OUT
May 19 12:24:13:694 [16436] cluster: doWork - check my resource groups
May 19 12:24:13:694 [16436] cluster: CheckMyResourceGroups(): - IN
May 19 12:24:13:694 [16436] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:699 [16436] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:24:13:699 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:699 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:699 [16436] cluster: CheckConfigVersionPds(): - IN
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:699 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:699 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:699 [16436] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:24:13:699 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:699 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:699 [16436] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:699 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:700 [16436] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:24:13:700 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:13:700 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:700 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:701 [16436] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:24:13:701 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:24:13:701 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:701 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:702 [16436] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:24:13:702 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:24:13:702 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:702 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:703 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:703 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:703 [16436] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:24:13:703 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:24:13:703 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:703 [16436] cluster: CheckConfigVersionPds(): - OUT
May 19 12:24:13:703 [16436] cluster: CheckMyResourceGroups(): - OUT
May 19 12:24:13:703 [16436] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:14:585 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:15:586 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:15:669 [8520] cluster: (Main)update node & group conf is starting in thread 3700
May 19 12:24:15:669 [8520] cluster: main - adding Sleep 10
May 19 12:24:15:669 [3700] cluster: doWork(): - IN
May 19 12:24:15:669 [3700] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:16:587 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:17:588 [20420] cluster: update node & group conf is starting in thread 8320
May 19 12:24:17:588 [8320] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:24:17:588 [8320] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:24:17:588 [8320] cluster: child udp_thread
May 19 12:24:17:588 [8320] cluster: child udp - Update node configs
May 19 12:24:17:588 [8320] cluster: updateNodeConf(): - IN
May 19 12:24:17:588 [8320] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:24:17:588 [8320] cluster: NodeConfigurationRequest(): - IN
May 19 12:24:17:588 [8320] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:24:17:588 [8320] cluster: PdsFromSection(): - IN
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster size=74
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: PdsFromSection(): - OUT
May 19 12:24:17:589 [8320] cluster: NodeConfigurationRequest(): - OUT
May 19 12:24:17:589 [8320] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:24:17:671 [8520] cluster: (Main)update node & group conf is starting in thread 12008
May 19 12:24:17:671 [8520] cluster: main - adding Sleep 10
May 19 12:24:17:671 [12008] cluster: doWork(): - IN
May 19 12:24:17:671 [12008] cluster: doWork - check nodes - do connection
May 19 12:24:17:671 [12008] cluster: ConnectAllNodes(): - IN
May 19 12:24:17:671 [12008] cluster: (ConnectAllNodes) - Start
May 19 12:24:17:671 [12008] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:24:17:671 [12008] cluster: ConnectToNode(): - IN
May 19 12:24:17:671 [12008] cluster: controller port is 48000
May 19 12:24:18:566 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:18:566 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56612  h=298 d=1417
May 19 12:24:18:566 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:24:18:566 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:24:18:566 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:24:18:566 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:24:18:566 [20420] cluster: set_node_version - from 10.27.163.134/56612 [0x10175b0]
May 19 12:24:18:566 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:24:18:566 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:24:18:566 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56612
May 19 12:24:18:566 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:24:18:566 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:24:18:566 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:24:18:567 [20420] cluster: RREQUEST: _close <-10.27.163.134/56612  h=287 d=0
May 19 12:24:18:567 [20420] cluster: sockClose:00000000010175B0:10.27.163.135/48003
May 19 12:24:18:567 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56613  h=299 d=866
May 19 12:24:18:567 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:24:18:567 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:24:18:567 [20420] cluster: set_group_version - from 10.27.163.134/56613 [0x10175b0]
May 19 12:24:18:568 [20420] cluster: set_group_version - pds received, size=866
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:24:18:568 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:24:18:568 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:24:18:568 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:24:18:568 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:24:18:568 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56613
May 19 12:24:18:568 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:24:18:568 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:24:18:568 [20420] cluster: RREQUEST: _close <-10.27.163.134/56613  h=287 d=0
May 19 12:24:18:569 [20420] cluster: sockClose:00000000010175B0:10.27.163.135/48003
May 19 12:24:19:570 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:19:672 [8520] cluster: main - adding Sleep 10
May 19 12:24:20:571 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:21:572 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:21:674 [8520] cluster: main - adding Sleep 10
May 19 12:24:22:573 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:22:671 [12008] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:24:22:671 [12008] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:24:22:671 [12008] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:24:22:671 [12008] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:24:22:671 [12008] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:24:22:671 [12008] cluster: ConnectAllNodes(): - OUT
May 19 12:24:22:671 [12008] cluster: Not connected to any nodes!
May 19 12:24:22:671 [12008] cluster: doWork - check nodes - state
May 19 12:24:22:671 [12008] cluster: CheckNodeState(): - Starting IN
May 19 12:24:22:678 [12008] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:22:678 [12008] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:22:678 [12008] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:22:678 [12008] cluster: FindNode() End - OUT
May 19 12:24:22:678 [12008] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:24:22:678 [12008] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:24:22:678 [12008] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:22:678 [12008] cluster: FindNode() End - OUT
May 19 12:24:22:678 [12008] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:24:22:678 [12008] cluster: CheckNodeState(): - OUT
May 19 12:24:22:678 [12008] cluster: doWork - check nodes - any new probes installed
May 19 12:24:22:678 [12008] cluster: ProbeInfoCheck(): - IN
May 19 12:24:22:678 [12008] cluster: ProbeInfoCheck(): - OUT
May 19 12:24:22:678 [12008] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:23:574 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:23:676 [8520] cluster: (Main)update node & group conf is starting in thread 15220
May 19 12:24:23:676 [8520] cluster: main - adding Sleep 10
May 19 12:24:23:676 [15220] cluster: doWork(): - IN
May 19 12:24:23:676 [15220] cluster: doWork - check groups
May 19 12:24:23:676 [15220] cluster: MapResourceGroups(): - IN
May 19 12:24:23:676 [15220] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:700 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:700 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:700 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:700 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:700 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:700 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:701 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:701 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:701 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:701 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:701 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:701 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:43:673 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:43:673 [6264] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:43:673 [6264] cluster: FindNode() End - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:43:673 [6264] cluster: FindGroup(): - IN
May 19 12:23:43:673 [6264] cluster: FindGroup(): - OUT
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - pds Deleted
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:43:673 [6264] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckRestart - end
May 19 12:23:43:673 [6264] cluster: MapResourceGroups(): - OUT
May 19 12:23:43:673 [6264] cluster: doWork - check my resource groups
May 19 12:23:43:673 [6264] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:43:673 [6264] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:43:673 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:673 [6264] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:43:673 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:43:673 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:674 [6264] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:43:674 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:43:674 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:675 [6264] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:43:675 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:675 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:43:676 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:676 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:43:677 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:677 [6264] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:43:678 [6264] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:678 [6264] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - IN
May 19 12:23:43:678 [6264] cluster: CheckResourceGroup(): - OUT
May 19 12:23:43:679 [6264] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:679 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:679 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:679 [6264] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:43:679 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:679 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:679 [6264] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:679 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:679 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:680 [6264] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:43:680 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:43:680 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:680 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:680 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:680 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:43:681 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:43:681 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:681 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:681 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection(): - IN
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - IN
May 19 12:23:43:682 [6264] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:682 [6264] cluster: recursive_section2pds(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsFromSection(): - OUT
May 19 12:23:43:682 [6264] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:43:682 [6264] cluster: PdsSectionMD5(): - OUT
May 19 12:23:43:682 [6264] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:43:682 [6264] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:43:682 [6264] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:44:560 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:45:561 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:45:644 [8520] cluster: (Main)update node & group conf is starting in thread 6548
May 19 12:23:45:644 [8520] cluster: main - adding Sleep 10
May 19 12:23:45:644 [6548] cluster: doWork(): - IN
May 19 12:23:45:644 [6548] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:46:562 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:47:562 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:47:645 [8520] cluster: (Main)update node & group conf is starting in thread 9292
May 19 12:23:47:645 [8520] cluster: main - adding Sleep 10
May 19 12:23:47:645 [9292] cluster: doWork(): - IN
May 19 12:23:47:645 [9292] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:48:563 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:49:564 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:49:647 [8520] cluster: (Main)update node & group conf is starting in thread 8708
May 19 12:23:49:647 [8520] cluster: main - adding Sleep 10
May 19 12:23:49:647 [8708] cluster: doWork(): - IN
May 19 12:23:49:647 [8708] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:50:565 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:51:566 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:51:649 [8520] cluster: (Main)update node & group conf is starting in thread 6668
May 19 12:23:51:649 [8520] cluster: main - adding Sleep 10
May 19 12:23:51:649 [6668] cluster: doWork(): - IN
May 19 12:23:51:649 [6668] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:52:567 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:53:567 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:53:650 [8520] cluster: (Main)update node & group conf is starting in thread 16608
May 19 12:23:53:650 [8520] cluster: main - adding Sleep 10
May 19 12:23:53:650 [16608] cluster: doWork(): - IN
May 19 12:23:53:650 [16608] cluster: doWork - check groups
May 19 12:23:53:650 [16608] cluster: MapResourceGroups(): - IN
May 19 12:23:53:650 [16608] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:674 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:674 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:674 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:674 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:674 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:674 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:674 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:674 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:674 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:674 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:674 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:674 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:674 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:674 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:675 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:675 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:675 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:675 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:23:53:675 [16608] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:23:53:675 [16608] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:23:53:675 [16608] cluster: FindNode() End - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:23:53:675 [16608] cluster: FindGroup(): - IN
May 19 12:23:53:675 [16608] cluster: FindGroup(): - OUT
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Group state set to 0
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - pds Deleted
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Node Active set to True
May 19 12:23:53:675 [16608] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - starting
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckRestart - end
May 19 12:23:53:675 [16608] cluster: MapResourceGroups(): - OUT
May 19 12:23:53:675 [16608] cluster: doWork - check my resource groups
May 19 12:23:53:675 [16608] cluster: CheckMyResourceGroups(): - IN
May 19 12:23:53:675 [16608] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:23:53:675 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:675 [16608] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:53:675 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:675 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:23:53:676 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:23:53:676 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:23:53:677 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:677 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:23:53:678 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:678 [16608] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - IN
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:23:53:679 [16608] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - IN
May 19 12:23:53:679 [16608] cluster: CheckResourceGroup(): - OUT
May 19 12:23:53:679 [16608] cluster: CheckConfigVersionPds(): - IN
May 19 12:23:53:679 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:679 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:680 [16608] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:680 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:680 [16608] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:23:53:680 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:23:53:680 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:680 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:680 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:680 [16608] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:23:53:680 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:23:53:681 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:23:53:681 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:681 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:681 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:682 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:682 [16608] cluster: PdsSectionMD5(): - IN
May 19 12:23:53:682 [16608] cluster: PdsFromSection(): - IN
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:683 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:683 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - IN
May 19 12:23:53:683 [16608] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:683 [16608] cluster: recursive_section2pds(): - OUT
May 19 12:23:53:683 [16608] cluster: PdsFromSection(): - OUT
May 19 12:23:53:683 [16608] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:23:53:683 [16608] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:23:53:683 [16608] cluster: PdsSectionMD5(): - OUT
May 19 12:23:53:683 [16608] cluster: CheckConfigVersionPds(): - OUT
May 19 12:23:53:683 [16608] cluster: CheckMyResourceGroups(): - OUT
May 19 12:23:53:683 [16608] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:54:568 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:55:569 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:55:652 [8520] cluster: (Main)update node & group conf is starting in thread 10088
May 19 12:23:55:652 [8520] cluster: main - adding Sleep 10
May 19 12:23:55:652 [10088] cluster: doWork(): - IN
May 19 12:23:55:652 [10088] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:56:570 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:57:571 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:57:654 [8520] cluster: (Main)update node & group conf is starting in thread 22384
May 19 12:23:57:654 [8520] cluster: main - adding Sleep 10
May 19 12:23:57:654 [22384] cluster: doWork(): - IN
May 19 12:23:57:654 [22384] cluster: node_state_resgroup_thread(): - OUT
May 19 12:23:58:572 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:59:560 [13480] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:23:59:560 [13480] cluster: (updateGroupConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:23:59:560 [13480] cluster: (updateGroupConf) - Finished!
May 19 12:23:59:560 [13480] cluster: updateGroupConf(): - OUT
May 19 12:23:59:560 [13480] cluster:  (update_node_group_conf_thread) Releasing gRestartCallbackLock 
May 19 12:23:59:572 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:23:59:656 [8520] cluster: (Main)update node & group conf is starting in thread 3688
May 19 12:23:59:656 [8520] cluster: main - adding Sleep 10
May 19 12:23:59:656 [3688] cluster: doWork(): - IN
May 19 12:23:59:656 [3688] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:00:573 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:01:574 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:01:657 [8520] cluster: (Main)update node & group conf is starting in thread 10228
May 19 12:24:01:657 [8520] cluster: main - adding Sleep 10
May 19 12:24:01:657 [10228] cluster: doWork(): - IN
May 19 12:24:01:657 [10228] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:02:575 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:03:576 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:03:659 [8520] cluster: (Main)update node & group conf is starting in thread 13016
May 19 12:24:03:659 [8520] cluster: main - adding Sleep 10
May 19 12:24:03:659 [13016] cluster: doWork(): - IN
May 19 12:24:03:659 [13016] cluster: doWork - check groups
May 19 12:24:03:659 [13016] cluster: MapResourceGroups(): - IN
May 19 12:24:03:659 [13016] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:03:679 [13016] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:679 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:679 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:679 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:680 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:680 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:680 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:03:680 [13016] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:03:680 [13016] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:03:680 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:03:681 [13016] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:03:681 [13016] cluster: FindNode() End - OUT
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:03:681 [13016] cluster: FindGroup(): - IN
May 19 12:24:03:681 [13016] cluster: FindGroup(): - OUT
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - pds Deleted
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:03:681 [13016] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckRestart - end
May 19 12:24:03:681 [13016] cluster: MapResourceGroups(): - OUT
May 19 12:24:03:681 [13016] cluster: doWork - check my resource groups
May 19 12:24:03:681 [13016] cluster: CheckMyResourceGroups(): - IN
May 19 12:24:03:681 [13016] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:24:03:681 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:681 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:682 [13016] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:03:682 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:682 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:24:03:683 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:683 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:24:03:684 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:684 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:03:685 [13016] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - IN
May 19 12:24:03:685 [13016] cluster: CheckResourceGroup(): - OUT
May 19 12:24:03:685 [13016] cluster: CheckConfigVersionPds(): - IN
May 19 12:24:03:685 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:685 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:24:03:686 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:686 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:686 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:687 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:687 [13016] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:24:03:687 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:24:03:687 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:687 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:687 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection(): - IN
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - IN
May 19 12:24:03:688 [13016] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: recursive_section2pds(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsFromSection(): - OUT
May 19 12:24:03:688 [13016] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:24:03:688 [13016] cluster: PdsSectionMD5(): - OUT
May 19 12:24:03:688 [13016] cluster: CheckConfigVersionPds(): - OUT
May 19 12:24:03:688 [13016] cluster: CheckMyResourceGroups(): - OUT
May 19 12:24:03:688 [13016] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:04:577 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:05:578 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:05:661 [8520] cluster: (Main)update node & group conf is starting in thread 15136
May 19 12:24:05:661 [8520] cluster: main - adding Sleep 10
May 19 12:24:05:661 [15136] cluster: doWork(): - IN
May 19 12:24:05:661 [15136] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:06:578 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:07:579 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:07:662 [8520] cluster: (Main)update node & group conf is starting in thread 16760
May 19 12:24:07:662 [8520] cluster: main - adding Sleep 10
May 19 12:24:07:662 [16760] cluster: doWork(): - IN
May 19 12:24:07:662 [16760] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:08:580 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:09:581 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:09:664 [8520] cluster: (Main)update node & group conf is starting in thread 3916
May 19 12:24:09:664 [8520] cluster: main - adding Sleep 10
May 19 12:24:09:664 [3916] cluster: doWork(): - IN
May 19 12:24:09:664 [3916] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:10:582 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:11:583 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:11:666 [8520] cluster: (Main)update node & group conf is starting in thread 14948
May 19 12:24:11:666 [8520] cluster: main - adding Sleep 10
May 19 12:24:11:666 [14948] cluster: doWork(): - IN
May 19 12:24:11:666 [14948] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:12:583 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:13:584 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:13:667 [8520] cluster: (Main)update node & group conf is starting in thread 16436
May 19 12:24:13:667 [8520] cluster: main - adding Sleep 10
May 19 12:24:13:667 [16436] cluster: doWork(): - IN
May 19 12:24:13:667 [16436] cluster: doWork - check groups
May 19 12:24:13:667 [16436] cluster: MapResourceGroups(): - IN
May 19 12:24:13:667 [16436] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:692 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:692 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:692 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:692 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:692 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:692 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:13:692 [16436] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:692 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:693 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:693 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:13:693 [16436] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:13:693 [16436] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:13:693 [16436] cluster: FindNode() End - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:13:693 [16436] cluster: FindGroup(): - IN
May 19 12:24:13:693 [16436] cluster: FindGroup(): - OUT
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - pds Deleted
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:13:693 [16436] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:24:13:693 [16436] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckRestart - end
May 19 12:24:13:694 [16436] cluster: MapResourceGroups(): - OUT
May 19 12:24:13:694 [16436] cluster: doWork - check my resource groups
May 19 12:24:13:694 [16436] cluster: CheckMyResourceGroups(): - IN
May 19 12:24:13:694 [16436] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:24:13:694 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:24:13:694 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:695 [16436] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:13:695 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:695 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:24:13:696 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:696 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:24:13:697 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:697 [16436] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:13:698 [16436] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:698 [16436] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:698 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:699 [16436] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:24:13:699 [16436] cluster: CheckResourceGroup(): - IN
May 19 12:24:13:699 [16436] cluster: CheckResourceGroup(): - OUT
May 19 12:24:13:699 [16436] cluster: CheckConfigVersionPds(): - IN
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:699 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:699 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:699 [16436] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:24:13:699 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:699 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:699 [16436] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:699 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:699 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:700 [16436] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:24:13:700 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:13:700 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:700 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:700 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:24:13:700 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:701 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:701 [16436] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:24:13:701 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:24:13:701 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:701 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:701 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:702 [16436] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:24:13:702 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:24:13:702 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:702 [16436] cluster: PdsSectionMD5(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection(): - IN
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - IN
May 19 12:24:13:702 [16436] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:24:13:702 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:703 [16436] cluster: recursive_section2pds(): - OUT
May 19 12:24:13:703 [16436] cluster: PdsFromSection(): - OUT
May 19 12:24:13:703 [16436] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:24:13:703 [16436] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:24:13:703 [16436] cluster: PdsSectionMD5(): - OUT
May 19 12:24:13:703 [16436] cluster: CheckConfigVersionPds(): - OUT
May 19 12:24:13:703 [16436] cluster: CheckMyResourceGroups(): - OUT
May 19 12:24:13:703 [16436] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:14:585 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:15:586 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:15:669 [8520] cluster: (Main)update node & group conf is starting in thread 3700
May 19 12:24:15:669 [8520] cluster: main - adding Sleep 10
May 19 12:24:15:669 [3700] cluster: doWork(): - IN
May 19 12:24:15:669 [3700] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:16:587 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:17:588 [20420] cluster: update node & group conf is starting in thread 8320
May 19 12:24:17:588 [8320] cluster:  (update_node_group_conf_thread) Waiting gRestartCallbackLock 
May 19 12:24:17:588 [8320] cluster:  (update_node_group_conf_thread) Locking gRestartCallbackLock 
May 19 12:24:17:588 [8320] cluster: child udp_thread
May 19 12:24:17:588 [8320] cluster: child udp - Update node configs
May 19 12:24:17:588 [8320] cluster: updateNodeConf(): - IN
May 19 12:24:17:588 [8320] cluster: (updateNodeConf) - This node ip/host: 10.27.163.135
May 19 12:24:17:588 [8320] cluster: NodeConfigurationRequest(): - IN
May 19 12:24:17:588 [8320] cluster: NodeConfigurationRequest - Get my current node config version
May 19 12:24:17:588 [8320] cluster: PdsFromSection(): - IN
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster size=74
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms size=83
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms/node size=216
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms/group size=263
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/alarms/failover size=205
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/qos size=69
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/nodes size=30
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/nodes/FRHDCLI-APBCT01 size=137
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - IN
May 19 12:24:17:589 [8320] cluster: PdsFromSection - section=/cluster/nodes/FRHDSTD-APBCT01 size=135
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: recursive_section2pds(): - OUT
May 19 12:24:17:589 [8320] cluster: PdsFromSection(): - OUT
May 19 12:24:17:589 [8320] cluster: NodeConfigurationRequest(): - OUT
May 19 12:24:17:589 [8320] cluster: (updateNodeConf) - Try to update node: FRHDSTD-APBCT01
May 19 12:24:17:671 [8520] cluster: (Main)update node & group conf is starting in thread 12008
May 19 12:24:17:671 [8520] cluster: main - adding Sleep 10
May 19 12:24:17:671 [12008] cluster: doWork(): - IN
May 19 12:24:17:671 [12008] cluster: doWork - check nodes - do connection
May 19 12:24:17:671 [12008] cluster: ConnectAllNodes(): - IN
May 19 12:24:17:671 [12008] cluster: (ConnectAllNodes) - Start
May 19 12:24:17:671 [12008] cluster: (ConnectAllNodes) - Try to connect to FRHDSTD-APBCT01
May 19 12:24:17:671 [12008] cluster: ConnectToNode(): - IN
May 19 12:24:17:671 [12008] cluster: controller port is 48000
May 19 12:24:18:566 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:18:566 [20420] cluster: RREQUEST: set_node_version <-10.27.163.134/56612  h=298 d=1417
May 19 12:24:18:566 [20420] cluster:  data   __file=cluster.cfg sections=PPDS(1289)
May 19 12:24:18:566 [20420] cluster: cmd_set_node_version(): -IN
May 19 12:24:18:566 [20420] cluster:  (cmd_set_node_version) Waiting gthreadCallbackLock 
May 19 12:24:18:566 [20420] cluster:  (cmd_set_node_version) Locking gthreadCallbackLock 
May 19 12:24:18:566 [20420] cluster: set_node_version - from 10.27.163.134/56612 [0x10175b0]
May 19 12:24:18:566 [20420] cluster: set_node_version - node=FRHDSTD-APBCT01 ver=2 md5=43659d70bca3935b9edee12bfb6a8f05
May 19 12:24:18:566 [20420] cluster: set_node_version - Sending reply...rc=0
May 19 12:24:18:566 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56612
May 19 12:24:18:566 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:24:18:566 [20420] cluster:  (cmd_set_node_version) Releasing gthreadCallbackLock 
May 19 12:24:18:566 [20420] cluster: cmd_set_node_version(): - OUT
May 19 12:24:18:567 [20420] cluster: RREQUEST: _close <-10.27.163.134/56612  h=287 d=0
May 19 12:24:18:567 [20420] cluster: sockClose:00000000010175B0:10.27.163.135/48003
May 19 12:24:18:567 [20420] cluster: RREQUEST: set_group_version <-10.27.163.134/56613  h=299 d=866
May 19 12:24:18:567 [20420] cluster:  data   /setup/groups/FRHDGSP-APBCT50=PDS(131) name=FRHDSTD-APBCT01
May 19 12:24:18:567 [20420] cluster: cmd_set_group_version(): - IN
May 19 12:24:18:567 [20420] cluster: set_group_version - from 10.27.163.134/56613 [0x10175b0]
May 19 12:24:18:568 [20420] cluster: set_group_version - pds received, size=866
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) gInitialized = 1
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) Waiting gthreadCallbackLock 
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) Locking gthreadCallbackLock 
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Available Storage, iVerRemote=1 remoteMd5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/Cluster Group, iVerRemote=1 remoteMd5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT03, iVerRemote=2 remoteMd5=16f978d6cb7b1638c959b50b9182a440
May 19 12:24:18:568 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT40, iVerRemote=1 remoteMd5=e70adc1a44c7edadbb5441f69b0eac7e
May 19 12:24:18:568 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:24:18:568 [20420] cluster: set_group_version - node=FRHDSTD-APBCT01 SectionName: /setup/groups/FRHDGSP-APBCT50, iVerRemote=1 remoteMd5=38118fc3c597fe0301811f0afaee495f
May 19 12:24:18:568 [20420] cluster: set_group_version - I got a newer version; do nothing - The caller will receive my version at next update.
May 19 12:24:18:568 [20420] cluster: set_group_version - Sending reply...rc=0
May 19 12:24:18:568 [20420] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56613
May 19 12:24:18:568 [20420] cluster:  head   mtype=200 status=0 seq=0
May 19 12:24:18:568 [20420] cluster:  (cmd_set_group_version) Releasing gthreadCallbackLock 
May 19 12:24:18:568 [20420] cluster: cmd_set_group_version(): - OUT
May 19 12:24:18:568 [20420] cluster: RREQUEST: _close <-10.27.163.134/56613  h=287 d=0
May 19 12:24:18:569 [20420] cluster: sockClose:00000000010175B0:10.27.163.135/48003
May 19 12:24:19:570 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:19:672 [8520] cluster: main - adding Sleep 10
May 19 12:24:20:571 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:21:572 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:21:674 [8520] cluster: main - adding Sleep 10
May 19 12:24:22:573 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:22:671 [12008] cluster: sockConnect - connect to 10.30.10.16 48000 failed 10060
May 19 12:24:22:671 [12008] cluster: nimRequest: SessionConnect failed: 10.30.10.16 48000
May 19 12:24:22:671 [12008] cluster: ConnectToNode - GetProbeIpPort failed with error code 2
May 19 12:24:22:671 [12008] cluster: (ConnectAllNodes) - node=FRHDSTD-APBCT01 failed: communication error
May 19 12:24:22:671 [12008] cluster: (ConnectAllNodes) - Found 0 nodes
May 19 12:24:22:671 [12008] cluster: ConnectAllNodes(): - OUT
May 19 12:24:22:671 [12008] cluster: Not connected to any nodes!
May 19 12:24:22:671 [12008] cluster: doWork - check nodes - state
May 19 12:24:22:671 [12008] cluster: CheckNodeState(): - Starting IN
May 19 12:24:22:678 [12008] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:22:678 [12008] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:22:678 [12008] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:22:678 [12008] cluster: FindNode() End - OUT
May 19 12:24:22:678 [12008] cluster: CheckNodeState - node='FRHDCLI-APBCT01', state='Up'
May 19 12:24:22:678 [12008] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:24:22:678 [12008] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:22:678 [12008] cluster: FindNode() End - OUT
May 19 12:24:22:678 [12008] cluster: CheckNodeState - node='FRHDSTD-APBCT01', state='Up'
May 19 12:24:22:678 [12008] cluster: CheckNodeState(): - OUT
May 19 12:24:22:678 [12008] cluster: doWork - check nodes - any new probes installed
May 19 12:24:22:678 [12008] cluster: ProbeInfoCheck(): - IN
May 19 12:24:22:678 [12008] cluster: ProbeInfoCheck(): - OUT
May 19 12:24:22:678 [12008] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:23:574 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:23:676 [8520] cluster: (Main)update node & group conf is starting in thread 15220
May 19 12:24:23:676 [8520] cluster: main - adding Sleep 10
May 19 12:24:23:676 [15220] cluster: doWork(): - IN
May 19 12:24:23:676 [15220] cluster: doWork - check groups
May 19 12:24:23:676 [15220] cluster: MapResourceGroups(): - IN
May 19 12:24:23:676 [15220] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:700 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:700 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:700 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:700 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:23:700 [15220] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:700 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:700 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:700 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:701 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:701 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:701 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:701 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:23:701 [15220] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:23:701 [15220] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:23:701 [15220] cluster: FindNode() End - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:23:701 [15220] cluster: FindGroup(): - IN
May 19 12:24:23:701 [15220] cluster: FindGroup(): - OUT
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - pds Deleted
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:23:701 [15220] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:24:23:701 [15220] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckRestart - end
May 19 12:24:23:702 [15220] cluster: MapResourceGroups(): - OUT
May 19 12:24:23:702 [15220] cluster: doWork - check my resource groups
May 19 12:24:23:702 [15220] cluster: CheckMyResourceGroups(): - IN
May 19 12:24:23:702 [15220] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:24:23:702 [15220] cluster: CheckResourceGroup(): - IN
May 19 12:24:23:702 [15220] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:23:702 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:702 [15220] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:24:23:702 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:23:702 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:703 [15220] cluster: CheckResourceGroup(): - OUT
May 19 12:24:23:703 [15220] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:24:23:703 [15220] cluster: CheckResourceGroup(): - IN
May 19 12:24:23:703 [15220] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:23:703 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:703 [15220] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:24:23:703 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:703 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:703 [15220] cluster: CheckResourceGroup(): - OUT
May 19 12:24:23:703 [15220] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:24:23:704 [15220] cluster: CheckResourceGroup(): - IN
May 19 12:24:23:704 [15220] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:23:704 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:704 [15220] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:24:23:704 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:704 [15220] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:24:23:704 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:704 [15220] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:705 [15220] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:24:23:705 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:705 [15220] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:24:23:705 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:705 [15220] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:24:23:705 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:705 [15220] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:23:706 [15220] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup(): - OUT
May 19 12:24:23:706 [15220] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup(): - IN
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup(): - OUT
May 19 12:24:23:706 [15220] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup(): - IN
May 19 12:24:23:706 [15220] cluster: CheckResourceGroup(): - OUT
May 19 12:24:23:706 [15220] cluster: CheckConfigVersionPds(): - IN
May 19 12:24:23:706 [15220] cluster: PdsSectionMD5(): - IN
May 19 12:24:23:706 [15220] cluster: PdsFromSection(): - IN
May 19 12:24:23:707 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:707 [15220] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:24:23:707 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:707 [15220] cluster: PdsFromSection(): - OUT
May 19 12:24:23:707 [15220] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:24:23:707 [15220] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:23:707 [15220] cluster: PdsSectionMD5(): - OUT
May 19 12:24:23:707 [15220] cluster: PdsSectionMD5(): - IN
May 19 12:24:23:707 [15220] cluster: PdsFromSection(): - IN
May 19 12:24:23:707 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:707 [15220] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:24:23:707 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: PdsFromSection(): - OUT
May 19 12:24:23:708 [15220] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:24:23:708 [15220] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:23:708 [15220] cluster: PdsSectionMD5(): - OUT
May 19 12:24:23:708 [15220] cluster: PdsSectionMD5(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection(): - IN
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:708 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:708 [15220] cluster: PdsFromSection(): - OUT
May 19 12:24:23:709 [15220] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:24:23:709 [15220] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:24:23:709 [15220] cluster: PdsSectionMD5(): - OUT
May 19 12:24:23:709 [15220] cluster: PdsSectionMD5(): - IN
May 19 12:24:23:709 [15220] cluster: PdsFromSection(): - IN
May 19 12:24:23:709 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:709 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:24:23:709 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:709 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:24:23:709 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:709 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:709 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:24:23:709 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:709 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:709 [15220] cluster: PdsFromSection(): - OUT
May 19 12:24:23:709 [15220] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:24:23:709 [15220] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:24:23:709 [15220] cluster: PdsSectionMD5(): - OUT
May 19 12:24:23:709 [15220] cluster: PdsSectionMD5(): - IN
May 19 12:24:23:709 [15220] cluster: PdsFromSection(): - IN
May 19 12:24:23:710 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:710 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:24:23:710 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:710 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:24:23:710 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:710 [15220] cluster: recursive_section2pds(): - IN
May 19 12:24:23:710 [15220] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:24:23:710 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:710 [15220] cluster: recursive_section2pds(): - OUT
May 19 12:24:23:710 [15220] cluster: PdsFromSection(): - OUT
May 19 12:24:23:710 [15220] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:24:23:710 [15220] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:24:23:710 [15220] cluster: PdsSectionMD5(): - OUT
May 19 12:24:23:710 [15220] cluster: CheckConfigVersionPds(): - OUT
May 19 12:24:23:710 [15220] cluster: CheckMyResourceGroups(): - OUT
May 19 12:24:23:710 [15220] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:24:575 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:25:575 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:25:677 [8520] cluster: (Main)update node & group conf is starting in thread 9952
May 19 12:24:25:677 [8520] cluster: main - adding Sleep 10
May 19 12:24:25:677 [9952] cluster: doWork(): - IN
May 19 12:24:25:677 [9952] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:26:576 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:27:577 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:27:679 [8520] cluster: (Main)update node & group conf is starting in thread 14600
May 19 12:24:27:679 [8520] cluster: main - adding Sleep 10
May 19 12:24:27:679 [14600] cluster: doWork(): - IN
May 19 12:24:27:679 [14600] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:28:578 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:29:579 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:29:681 [8520] cluster: (Main)update node & group conf is starting in thread 16492
May 19 12:24:29:681 [8520] cluster: main - adding Sleep 10
May 19 12:24:29:681 [16492] cluster: doWork(): - IN
May 19 12:24:29:681 [16492] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:30:580 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:30:660 [8520] cluster: RREQUEST: set_node_up <-10.27.163.134/56618  h=293 d=106
May 19 12:24:30:660 [8520] cluster: nimSockaddr2Ip - found 10.27.163.134
May 19 12:24:30:660 [8520] cluster: SREQUEST: verify_login ->10.27.163.135/48000
May 19 12:24:30:664 [8520] cluster: RREPLY: status=OK(0) <-10.27.163.135/48000  h=37 d=50
May 19 12:24:30:664 [8520] cluster:  head   mtype=200 status=0 seq=0
May 19 12:24:30:664 [8520] cluster:  data   time=1589883870 access=2 ident=31548
May 19 12:24:30:664 [8520] cluster: sockClose:00000000010175B0:10.27.163.135/56413
May 19 12:24:30:664 [8520] cluster: SREQUEST: _close ->10.27.163.135/48000
May 19 12:24:30:664 [8520] cluster: cmd_set_node_up(): - IN
May 19 12:24:30:664 [8520] cluster: set_node_up - from 10.27.163.134/56618 [0x10160f0]
May 19 12:24:30:664 [8520] cluster: cmd_set_node_up(): - OUT
May 19 12:24:30:664 [3896] cluster: thrSetNodeUp(): - IN
May 19 12:24:30:664 [3896] cluster:  (thrSetNodeUp) Waiting gthreadCallbackLock 
May 19 12:24:30:664 [3896] cluster:  (thrSetNodeUp) Locking gthreadCallbackLock 
May 19 12:24:30:664 [3896] cluster: FindNode() [FRHDSTD-APBCT01] - IN
May 19 12:24:30:664 [3896] cluster: Find Node() match node[FRHDSTD-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:30:664 [3896] cluster: FindNode() End - OUT
May 19 12:24:30:664 [3896] cluster: thrSetNodeUp - Caller address: /TotalDxim/SDCPPDXIM07/frhdstd-apbct01/cluster, My adress: 10.27.163.135
May 19 12:24:30:664 [3896] cluster: SREPLY: status = 0(OK) ->10.27.163.134/56618
May 19 12:24:30:664 [3896] cluster:  head   mtype=200 status=0 seq=0
May 19 12:24:30:664 [3896] cluster: sockClose:00000000010160F0:10.27.163.135/48008
May 19 12:24:30:664 [3896] cluster: SREQUEST: _close ->10.27.163.134/56618
May 19 12:24:30:664 [3896] cluster:  (thrSetNodeUp) Releasing gthreadCallbackLock 
May 19 12:24:30:664 [3896] cluster: thrSetNodeUp(): - OUT
May 19 12:24:31:580 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:31:664 [8520] cluster: (Main)update node & group conf is starting in thread 9420
May 19 12:24:31:664 [8520] cluster: main - adding Sleep 10
May 19 12:24:31:664 [9420] cluster: doWork(): - IN
May 19 12:24:31:664 [9420] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:32:581 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:33:582 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:33:666 [8520] cluster: (Main)update node & group conf is starting in thread 8540
May 19 12:24:33:666 [8520] cluster: main - adding Sleep 10
May 19 12:24:33:666 [8540] cluster: doWork(): - IN
May 19 12:24:33:666 [8540] cluster: doWork - check groups
May 19 12:24:33:666 [8540] cluster: MapResourceGroups(): - IN
May 19 12:24:33:666 [8540] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:33:691 [8540] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:33:691 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:33:691 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:33:691 [8540] cluster: FindNode() End - OUT
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:33:691 [8540] cluster: FindGroup(): - IN
May 19 12:24:33:691 [8540] cluster: FindGroup(): - OUT
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - pds Deleted
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:33:691 [8540] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:33:692 [8540] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:33:692 [8540] cluster: FindNode() End - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:33:692 [8540] cluster: FindGroup(): - IN
May 19 12:24:33:692 [8540] cluster: FindGroup(): - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - pds Deleted
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:33:692 [8540] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:33:692 [8540] cluster: FindNode() End - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:33:692 [8540] cluster: FindGroup(): - IN
May 19 12:24:33:692 [8540] cluster: FindGroup(): - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - pds Deleted
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:33:692 [8540] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:33:692 [8540] cluster: FindNode() End - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:33:692 [8540] cluster: FindGroup(): - IN
May 19 12:24:33:692 [8540] cluster: FindGroup(): - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - pds Deleted
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:33:692 [8540] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:33:692 [8540] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:33:692 [8540] cluster: FindNode() End - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:33:692 [8540] cluster: FindGroup(): - IN
May 19 12:24:33:692 [8540] cluster: FindGroup(): - OUT
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:33:692 [8540] cluster: MapResourceGroups - pds Deleted
May 19 12:24:33:693 [8540] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:33:693 [8540] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:33:693 [8540] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:33:693 [8540] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckRestart - end
May 19 12:24:33:693 [8540] cluster: MapResourceGroups(): - OUT
May 19 12:24:33:693 [8540] cluster: doWork - check my resource groups
May 19 12:24:33:693 [8540] cluster: CheckMyResourceGroups(): - IN
May 19 12:24:33:693 [8540] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:24:33:693 [8540] cluster: CheckResourceGroup(): - IN
May 19 12:24:33:693 [8540] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:33:693 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:693 [8540] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:24:33:693 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:693 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup(): - OUT
May 19 12:24:33:694 [8540] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup(): - IN
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:694 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup(): - OUT
May 19 12:24:33:694 [8540] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup(): - IN
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:33:694 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:695 [8540] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:24:33:695 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:695 [8540] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:24:33:695 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:695 [8540] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:696 [8540] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:24:33:696 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:696 [8540] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:24:33:696 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:696 [8540] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:24:33:696 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:696 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:697 [8540] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:24:33:697 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:697 [8540] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:24:33:697 [8540] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:697 [8540] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:33:698 [8540] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:33:698 [8540] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:33:698 [8540] cluster: CheckResourceGroup(): - OUT
May 19 12:24:33:698 [8540] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:24:33:698 [8540] cluster: CheckResourceGroup(): - IN
May 19 12:24:33:698 [8540] cluster: CheckResourceGroup(): - OUT
May 19 12:24:33:698 [8540] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:24:33:698 [8540] cluster: CheckResourceGroup(): - IN
May 19 12:24:33:698 [8540] cluster: CheckResourceGroup(): - OUT
May 19 12:24:33:698 [8540] cluster: CheckConfigVersionPds(): - IN
May 19 12:24:33:698 [8540] cluster: PdsSectionMD5(): - IN
May 19 12:24:33:698 [8540] cluster: PdsFromSection(): - IN
May 19 12:24:33:698 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:698 [8540] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:24:33:698 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:698 [8540] cluster: PdsFromSection(): - OUT
May 19 12:24:33:698 [8540] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:24:33:698 [8540] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:33:698 [8540] cluster: PdsSectionMD5(): - OUT
May 19 12:24:33:698 [8540] cluster: PdsSectionMD5(): - IN
May 19 12:24:33:698 [8540] cluster: PdsFromSection(): - IN
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:699 [8540] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:699 [8540] cluster: PdsFromSection(): - OUT
May 19 12:24:33:699 [8540] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:24:33:699 [8540] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:33:699 [8540] cluster: PdsSectionMD5(): - OUT
May 19 12:24:33:699 [8540] cluster: PdsSectionMD5(): - IN
May 19 12:24:33:699 [8540] cluster: PdsFromSection(): - IN
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:699 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:699 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:699 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:699 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:699 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:700 [8540] cluster: PdsFromSection(): - OUT
May 19 12:24:33:700 [8540] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:24:33:700 [8540] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:24:33:700 [8540] cluster: PdsSectionMD5(): - OUT
May 19 12:24:33:700 [8540] cluster: PdsSectionMD5(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection(): - IN
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:700 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:700 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:701 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:701 [8540] cluster: PdsFromSection(): - OUT
May 19 12:24:33:701 [8540] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:24:33:701 [8540] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:24:33:701 [8540] cluster: PdsSectionMD5(): - OUT
May 19 12:24:33:701 [8540] cluster: PdsSectionMD5(): - IN
May 19 12:24:33:701 [8540] cluster: PdsFromSection(): - IN
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:701 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:701 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - IN
May 19 12:24:33:701 [8540] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:701 [8540] cluster: recursive_section2pds(): - OUT
May 19 12:24:33:702 [8540] cluster: PdsFromSection(): - OUT
May 19 12:24:33:702 [8540] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:24:33:702 [8540] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:24:33:702 [8540] cluster: PdsSectionMD5(): - OUT
May 19 12:24:33:702 [8540] cluster: CheckConfigVersionPds(): - OUT
May 19 12:24:33:702 [8540] cluster: CheckMyResourceGroups(): - OUT
May 19 12:24:33:702 [8540] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:34:583 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:35:584 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:35:668 [8520] cluster: (Main)update node & group conf is starting in thread 21388
May 19 12:24:35:668 [8520] cluster: main - adding Sleep 10
May 19 12:24:35:668 [21388] cluster: doWork(): - IN
May 19 12:24:35:668 [21388] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:36:585 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:37:585 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:37:670 [8520] cluster: (Main)update node & group conf is starting in thread 10016
May 19 12:24:37:670 [8520] cluster: main - adding Sleep 10
May 19 12:24:37:670 [10016] cluster: doWork(): - IN
May 19 12:24:37:670 [10016] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:38:586 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:38:588 [8320] cluster: sockConnect - connect to 10.30.10.16 48003 failed 10060
May 19 12:24:38:588 [8320] cluster: (updateNodeConf) - Connect to ip/host: 10.30.10.16
May 19 12:24:38:588 [8320] cluster: (updateNodeConf) - sockConnect failed to ip/host=10.30.10.16
May 19 12:24:38:588 [8320] cluster: updateNodeConf(): - OUT
May 19 12:24:38:588 [8320] cluster: child udp - Update group configs
May 19 12:24:38:588 [8320] cluster: updateGroupConf(): - IN
May 19 12:24:38:588 [8320] cluster: (updateGroupConf) - This node ip/host: 10.27.163.135
May 19 12:24:38:588 [8320] cluster: ResourceGroupConfigurationRequest(): - IN
May 19 12:24:38:588 [8320] cluster: ResourceGroupConfigurationRequest(): - OUT
May 19 12:24:38:588 [8320] cluster: (updateGroupConf) - Connect to ip/host: 10.30.10.16, port: 48003
May 19 12:24:39:587 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:39:671 [8520] cluster: (Main)update node & group conf is starting in thread 10856
May 19 12:24:39:671 [8520] cluster: main - adding Sleep 10
May 19 12:24:39:671 [10856] cluster: doWork(): - IN
May 19 12:24:39:671 [10856] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:40:588 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:41:589 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:41:673 [8520] cluster: (Main)update node & group conf is starting in thread 14124
May 19 12:24:41:673 [8520] cluster: main - adding Sleep 10
May 19 12:24:41:673 [14124] cluster: doWork(): - IN
May 19 12:24:41:673 [14124] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:42:590 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:43:591 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:43:675 [8520] cluster: (Main)update node & group conf is starting in thread 21728
May 19 12:24:43:675 [8520] cluster: main - adding Sleep 10
May 19 12:24:43:675 [21728] cluster: doWork(): - IN
May 19 12:24:43:675 [21728] cluster: doWork - check groups
May 19 12:24:43:675 [21728] cluster: MapResourceGroups(): - IN
May 19 12:24:43:675 [21728] cluster: MapResourceGroups - Call PluginGetResourceGroup
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Available Storage on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:43:701 [21728] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:43:701 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:43:701 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:43:701 [21728] cluster: FindNode() End - OUT
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:43:701 [21728] cluster: FindGroup(): - IN
May 19 12:24:43:701 [21728] cluster: FindGroup(): - OUT
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Find Group Available Storage in Cluster
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Number of Groups Increased to 1
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - pds Deleted
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Freed : name - Available Storage, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - loop Count incremented to 1
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Cluster Group on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:43:701 [21728] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:43:701 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:43:701 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:43:701 [21728] cluster: FindNode() End - OUT
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:43:701 [21728] cluster: FindGroup(): - IN
May 19 12:24:43:701 [21728] cluster: FindGroup(): - OUT
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Find Group Cluster Group in Cluster
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Number of Groups Increased to 2
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - pds Deleted
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - Freed : name - Cluster Group, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:43:701 [21728] cluster: MapResourceGroups - loop Count incremented to 2
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - FRHDGSP-APBCT03 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:43:702 [21728] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:43:702 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:43:702 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:43:702 [21728] cluster: FindNode() End - OUT
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:43:702 [21728] cluster: FindGroup(): - IN
May 19 12:24:43:702 [21728] cluster: FindGroup(): - OUT
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT03 in Cluster
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Number of Groups Increased to 3
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - pds Deleted
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT03, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - loop Count incremented to 3
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - FRHDGSP-APBCT40 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:43:702 [21728] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:43:702 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:43:702 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:43:702 [21728] cluster: FindNode() End - OUT
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:43:702 [21728] cluster: FindGroup(): - IN
May 19 12:24:43:702 [21728] cluster: FindGroup(): - OUT
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT40 in Cluster
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Number of Groups Increased to 4
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - pds Deleted
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT40, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - loop Count incremented to 4
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - FRHDGSP-APBCT50 on FRHDCLI-APBCT01 is Online (0)
May 19 12:24:43:702 [21728] cluster: FindNode() [FRHDCLI-APBCT01] - IN
May 19 12:24:43:702 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDSTD-APBCT01]
May 19 12:24:43:702 [21728] cluster: Find Node() match node[FRHDCLI-APBCT01] with list node[FRHDCLI-APBCT01]
May 19 12:24:43:702 [21728] cluster: FindNode() End - OUT
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Find Node FRHDCLI-APBCT01 in Cluster
May 19 12:24:43:702 [21728] cluster: FindGroup(): - IN
May 19 12:24:43:702 [21728] cluster: FindGroup(): - OUT
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Find Group FRHDGSP-APBCT50 in Cluster
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Number of Groups Increased to 5
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Group state set to 0
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - pds Deleted
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Freed : name - FRHDGSP-APBCT50, node - FRHDCLI-APBCT01, text - Online
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - loop Count incremented to 5
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Node Active set to True
May 19 12:24:43:702 [21728] cluster: MapResourceGroups - Check if probes should be restarted
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - starting
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - check probe cdm
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - no restart scheduled for probe cdm
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - check probe ntservices
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntservices
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - check probe sqlserver
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - no restart scheduled for probe sqlserver
May 19 12:24:43:702 [21728] cluster: ProbeInfoCheckRestart - check probe nexec
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckRestart - no restart scheduled for probe nexec
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckRestart - check probe ntevl
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckRestart - no restart scheduled for probe ntevl
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckRestart - end
May 19 12:24:43:703 [21728] cluster: MapResourceGroups(): - OUT
May 19 12:24:43:703 [21728] cluster: doWork - check my resource groups
May 19 12:24:43:703 [21728] cluster: CheckMyResourceGroups(): - IN
May 19 12:24:43:703 [21728] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT50
May 19 12:24:43:703 [21728] cluster: CheckResourceGroup(): - IN
May 19 12:24:43:703 [21728] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:43:703 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_svscsffi.pds
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:703 [21728] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT50/disk desc=Disk monitoring - profiles
May 19 12:24:43:703 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT50
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_iyvcqndq.pds
May 19 12:24:43:703 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup(): - OUT
May 19 12:24:43:704 [21728] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT40
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup(): - IN
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_hlrdhxrp.pds
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT40/disk desc=Disk monitoring - profiles
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT40
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_khpbmsyi.pds
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup(): - OUT
May 19 12:24:43:704 [21728] cluster: CheckMyResourceGroups - group=FRHDGSP-APBCT03
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup(): - IN
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup - probe=cdm profile=/messages desc=Disk monitoring - messages
May 19 12:24:43:704 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:704 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_uejumssi.pds
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:705 [21728] cluster: CheckResourceGroup - probe=cdm profile=/cluster/FRHDGSP-APBCT03/disk desc=Disk monitoring - profiles
May 19 12:24:43:705 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_lvpdvvfg.pds
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:705 [21728] cluster: CheckResourceGroup - probe=sqlserver profile=/connections desc=Connections
May 19 12:24:43:705 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:705 [21728] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_cvfrgeue.pds
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:706 [21728] cluster: CheckResourceGroup - probe=sqlserver profile=/profiles/frhdgsp-apbct30\APBCT100PPI desc=
May 19 12:24:43:706 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - sqlserver cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\sqlserver_sqosnuvf.pds
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:706 [21728] cluster: CheckResourceGroup - probe=ntservices profile=/services/SQLAgent$APBCT100PPI desc=SQLAgent$APBCT100PPI
May 19 12:24:43:706 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_zoxgkhpp.pds
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:706 [21728] cluster: CheckResourceGroup - probe=ntservices profile=/services/MSSQL$APBCT100PPI desc=MSSQL$APBCT100PPI
May 19 12:24:43:706 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:706 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - ntservices cfg modified at Tue May 19 12:19:22 2020
 
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\ntservices_qeqghqrc.pds
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:22 2020
 
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:707 [21728] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/F:\ desc=File system F:\
May 19 12:24:43:707 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_trvzcpvl.pds
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:707 [21728] cluster: CheckResourceGroup - probe=cdm profile=/disk/alarm/fixed/E:\ desc=File system E:\
May 19 12:24:43:707 [21728] cluster: CheckResourceGroup - checking active resource group FRHDGSP-APBCT03
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource(): - IN
May 19 12:24:43:707 [21728] cluster: ProbeInfoCheckResource - cdm cfg modified at Tue May 19 12:19:59 2020
 
May 19 12:24:43:708 [21728] cluster: ProbeInfoCheckResource - checking pds file FRHDGSP-APBCT03\cdm_skskokpi.pds
May 19 12:24:43:708 [21728] cluster: ProbeInfoCheckResource - r->mtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:708 [21728] cluster: ProbeInfoCheckResource - cfgmtime Tue May 19 12:19:59 2020
 
May 19 12:24:43:708 [21728] cluster: ProbeInfoCheckResource - resource unchanged
May 19 12:24:43:708 [21728] cluster: ProbeInfoCheckResource(): - OUT
May 19 12:24:43:708 [21728] cluster: CheckResourceGroup(): - OUT
May 19 12:24:43:708 [21728] cluster: CheckMyResourceGroups - group=Cluster Group
May 19 12:24:43:708 [21728] cluster: CheckResourceGroup(): - IN
May 19 12:24:43:708 [21728] cluster: CheckResourceGroup(): - OUT
May 19 12:24:43:708 [21728] cluster: CheckMyResourceGroups - group=Available Storage
May 19 12:24:43:708 [21728] cluster: CheckResourceGroup(): - IN
May 19 12:24:43:708 [21728] cluster: CheckResourceGroup(): - OUT
May 19 12:24:43:708 [21728] cluster: CheckConfigVersionPds(): - IN
May 19 12:24:43:708 [21728] cluster: PdsSectionMD5(): - IN
May 19 12:24:43:708 [21728] cluster: PdsFromSection(): - IN
May 19 12:24:43:708 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:708 [21728] cluster: PdsFromSection - section=/groups/Available Storage size=96
May 19 12:24:43:708 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:708 [21728] cluster: PdsFromSection(): - OUT
May 19 12:24:43:708 [21728] cluster: PdsMD5Sum - MD5=723ed3ed6de16e797bfbd8982836d31b size=150
May 19 12:24:43:708 [21728] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Available Storage md5=723ed3ed6de16e797bfbd8982836d31b
May 19 12:24:43:708 [21728] cluster: PdsSectionMD5(): - OUT
May 19 12:24:43:708 [21728] cluster: PdsSectionMD5(): - IN
May 19 12:24:43:708 [21728] cluster: PdsFromSection(): - IN
May 19 12:24:43:709 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:709 [21728] cluster: PdsFromSection - section=/groups/Cluster Group size=88
May 19 12:24:43:709 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:709 [21728] cluster: PdsFromSection(): - OUT
May 19 12:24:43:709 [21728] cluster: PdsMD5Sum - MD5=adf51788873e0e8609c853fd2cdf2df6 size=142
May 19 12:24:43:709 [21728] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/Cluster Group md5=adf51788873e0e8609c853fd2cdf2df6
May 19 12:24:43:709 [21728] cluster: PdsSectionMD5(): - OUT
May 19 12:24:43:709 [21728] cluster: PdsSectionMD5(): - IN
May 19 12:24:43:709 [21728] cluster: PdsFromSection(): - IN
May 19 12:24:43:709 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:709 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03 size=92
May 19 12:24:43:709 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/1 size=289
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/2 size=289
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/4 size=312
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/5 size=318
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/7 size=302
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/6 size=285
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/0 size=293
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT03/8 size=272
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:710 [21728] cluster: PdsFromSection(): - OUT
May 19 12:24:43:710 [21728] cluster: PdsMD5Sum - MD5=239ebf4ac82b9c62a8578cc900926953 size=2578
May 19 12:24:43:710 [21728] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT03 md5=239ebf4ac82b9c62a8578cc900926953
May 19 12:24:43:710 [21728] cluster: PdsSectionMD5(): - OUT
May 19 12:24:43:710 [21728] cluster: PdsSectionMD5(): - IN
May 19 12:24:43:710 [21728] cluster: PdsFromSection(): - IN
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:711 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40 size=92
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:711 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/0 size=293
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:711 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT40/1 size=272
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:711 [21728] cluster: PdsFromSection(): - OUT
May 19 12:24:43:711 [21728] cluster: PdsMD5Sum - MD5=0daaa1b81161a11df775bc2b296f4e2b size=729
May 19 12:24:43:711 [21728] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT40 md5=0daaa1b81161a11df775bc2b296f4e2b
May 19 12:24:43:711 [21728] cluster: PdsSectionMD5(): - OUT
May 19 12:24:43:711 [21728] cluster: PdsSectionMD5(): - IN
May 19 12:24:43:711 [21728] cluster: PdsFromSection(): - IN
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:711 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50 size=92
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:711 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/0 size=293
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - IN
May 19 12:24:43:711 [21728] cluster: PdsFromSection - section=/groups/FRHDGSP-APBCT50/1 size=272
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:711 [21728] cluster: recursive_section2pds(): - OUT
May 19 12:24:43:711 [21728] cluster: PdsFromSection(): - OUT
May 19 12:24:43:711 [21728] cluster: PdsMD5Sum - MD5=1ff1e93f62a60b5591d70d453b2ba6b0 size=729
May 19 12:24:43:711 [21728] cluster: PdsSectionMD5 - file=cluster.cfg section=/groups/FRHDGSP-APBCT50 md5=1ff1e93f62a60b5591d70d453b2ba6b0
May 19 12:24:43:711 [21728] cluster: PdsSectionMD5(): - OUT
May 19 12:24:43:711 [21728] cluster: CheckConfigVersionPds(): - OUT
May 19 12:24:43:711 [21728] cluster: CheckMyResourceGroups(): - OUT
May 19 12:24:43:711 [21728] cluster: node_state_resgroup_thread(): - OUT
May 19 12:24:44:591 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:45:592 [20420] cluster:  (update_node_group_conf_thread) Required Wait interval not complete. Will check in next cycle.
May 19 12:24:45:676 [8520] cluster: (Main)update node & group conf is starting in thread 19468
May 19 12:24:45:676 [8520] cluster: main - adding Sleep 10
May 19 12:24:45:676 [19468] cluster: doWork(): - IN
May 19 12:24:45:676 [19468] cluster: node_state_resgroup_thread(): - OUT