at com.vmware.vim25.mo.ServiceInstance.(ServiceInstance.java:79) at com.vmware.vim25.mo.ServiceInstance.(ServiceInstance.java:69) at com.nimsoft.probe.application.vmware.sdk.VmwareEnvAdaptor$ServiceInstanceFactory.getServiceInstance(VmwareEnvAdaptor.java:201) at com.nimsoft.probe.application.vmware.sdk.VmwareEnvAdaptor.login(VmwareEnvAdaptor.java:259) ... 14 more Mar 09 01:16:55:506 [Data Collector - USASHSMINPVW01, vmware] PERF: START: Vmware setup graph with resource USASHSMINPVW01 Mar 09 01:16:55:507 [Data Collector - USASHSMINPVW01, vmware] PERF: DONE: Vmware setup graph with resource USASHSMINPVW01 {Seconds=0.001} Mar 09 01:16:55:507 [Data Collector - USASHSMINPVW01, vmware] Inventory update failed. Sending resource alarm Mar 09 01:16:55:507 [Data Collector - USASHSMINPVW01, vmware] (12) login failed, VMWare API is unavailable. at com.nimsoft.probe.application.vmware.sdk.VmwareSession.updateInventory(VmwareSession.java:167) at com.nimsoft.probe.common.ctd.CtdSession.doInventoryUpdate(CtdSession.java:257) at com.nimsoft.probe.application.vmware.collector.VmwareDataCollector.executeSessionUpdateInventory(VmwareDataCollector.java:213) at com.nimsoft.probe.common.ctd.ProbeDataCollector.execute(ProbeDataCollector.java:217) at com.nimsoft.vm.collector.DataCollector.run(DataCollector.java:151) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Mar 09 01:16:55:507 [Data Collector - USASHSMINPVW01, vmware] PERF: DONE: ----- Pass-1701 --- Data Collector Check Interval for: USASHSMINPVW01 {Seconds=4.340} Mar 09 01:16:55:507 [Data Collector - USASHSMINPVW01, vmware] PERF: Memory Status: Max=1498 CurrentAllocated=1498 Free=804 Used=694 MB Mar 09 01:16:55:507 [Data Collector - USASHSMINPVW01, vmware] DataCollector for USASHSMINPVW01 finished collecting data Mar 09 01:18:06:169 [Data Collector - usashsmvcpvw01, vmware] DataCollector for usashsmvcpvw01 collecting data Mar 09 01:18:06:169 [Data Collector - usashsmvcpvw01, vmware] PERF: START: ----- Pass-1701 --- Data Collector Check Interval for: usashsmvcpvw01 Mar 09 01:18:06:169 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1488 CurrentAllocated=1488 Free=805 Used=683 MB Mar 09 01:18:06:170 [Data Collector - JPTOKSMVMPW01, vmware] DataCollector for JPTOKSMVMPW01 collecting data Mar 09 01:18:06:170 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: ----- Pass-851 --- Data Collector Check Interval for: JPTOKSMVMPW01 Mar 09 01:18:06:170 [Data Collector - JPTOKSMVMPW01, vmware] PERF: Memory Status: Max=1488 CurrentAllocated=1488 Free=799 Used=689 MB Mar 09 01:18:06:362 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Vmware setup graph with resource usashsmvcpvw01 Mar 09 01:18:06:456 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update property metrics Mar 09 01:18:06:456 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Check for property updates: https://usashsmvcpvw01:443/sdk Mar 09 01:18:06:551 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Check for property updates: https://usashsmvcpvw01:443/sdk {Seconds=0.095} Mar 09 01:18:06:551 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Apply property updates Mar 09 01:18:06:552 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Apply property updates {Seconds=0.000} Mar 09 01:18:06:552 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Check for quick stat updates: https://usashsmvcpvw01:443/sdk Mar 09 01:18:06:810 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Vmware setup graph with resource JPTOKSMVMPW01 Mar 09 01:18:06:973 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Vmware setup graph with resource JPTOKSMVMPW01 {Seconds=0.163} Mar 09 01:18:06:973 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Vmware inventory update for JPTOKSMVMPW01 Mar 09 01:18:06:973 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Check for topology updates: https://JPTOKSMVMPW01:443/sdk Mar 09 01:18:07:135 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Check for topology updates: https://JPTOKSMVMPW01:443/sdk {Seconds=0.162} Mar 09 01:18:07:135 [Data Collector - JPTOKSMVMPW01, vmware] 0 VMs filtered out from inventory Mar 09 01:18:07:135 [Data Collector - JPTOKSMVMPW01, vmware] PERF: Memory Status: Max=1488 CurrentAllocated=1488 Free=787 Used=701 MB Mar 09 01:18:07:135 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Update property metrics Mar 09 01:18:07:135 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Check for property updates: https://JPTOKSMVMPW01:443/sdk Mar 09 01:18:07:294 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Check for property updates: https://JPTOKSMVMPW01:443/sdk {Seconds=0.159} Mar 09 01:18:07:294 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Apply property updates Mar 09 01:18:07:294 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Apply property updates {Seconds=0.000} Mar 09 01:18:07:294 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Check for quick stat updates: https://JPTOKSMVMPW01:443/sdk Mar 09 01:18:07:572 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Apply quick stat updates Mar 09 01:18:07:572 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Apply quick stat updates {Seconds=0.000} Mar 09 01:18:07:572 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update property values in graph Mar 09 01:18:07:822 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update property values in graph {Seconds=0.250} Mar 09 01:18:07:822 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update property metrics {Seconds=1.366} Mar 09 01:18:07:822 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1488 CurrentAllocated=1488 Free=634 Used=854 MB Mar 09 01:18:07:822 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update array values in graph Mar 09 01:18:07:838 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update array values in graph {Seconds=0.016} Mar 09 01:18:07:838 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1488 CurrentAllocated=1488 Free=629 Used=859 MB Mar 09 01:18:07:928 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update perf metrics Mar 09 01:18:07:984 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Check for quick stat updates: https://JPTOKSMVMPW01:443/sdk {Seconds=0.690} Mar 09 01:18:07:984 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Apply quick stat updates Mar 09 01:18:07:984 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Apply quick stat updates {Seconds=0.000} Mar 09 01:18:07:984 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Update property values in graph Mar 09 01:18:07:998 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Update property values in graph {Seconds=0.014} Mar 09 01:18:07:998 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Update property metrics {Seconds=0.863} Mar 09 01:18:07:998 [Data Collector - JPTOKSMVMPW01, vmware] PERF: Memory Status: Max=1481 CurrentAllocated=1481 Free=1013 Used=468 MB Mar 09 01:18:07:998 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Update array values in graph Mar 09 01:18:07:999 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Update array values in graph {Seconds=0.001} Mar 09 01:18:07:999 [Data Collector - JPTOKSMVMPW01, vmware] PERF: Memory Status: Max=1481 CurrentAllocated=1481 Free=1012 Used=469 MB Mar 09 01:18:08:223 [Performance Metric Collection - 30, vmware] Batch fetching of perf metrics failed. Retrying as individual requests Mar 09 01:18:08:332 [Performance Metric Collection - 30, vmware] Failed to execute single perf query for entity resgroup-786. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:18:08:373 [Performance Metric Collection - 30, vmware] Failed to execute single perf query for entity resgroup-65241. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:18:07:572 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Check for quick stat updates: https://usashsmvcpvw01:443/sdk {Seconds=1.020} Mar 09 01:18:08:594 [Performance Metric Collection - 30, vmware] Failed to execute single perf query for entity resgroup-43. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:18:08:827 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Update perf metrics Mar 09 01:18:11:151 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Update properties from DataCenter: Datacenter {Seconds=0.000} Mar 09 01:18:11:172 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Recreating nodes to update properties {Seconds=0.022} Mar 09 01:18:11:172 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Vmware inventory update for JPTOKSMVMPW01 {Seconds=4.199} Mar 09 01:18:11:172 [Data Collector - JPTOKSMVMPW01, vmware] vmware inventory alarm update started Mar 09 01:18:11:330 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Updating perf metric exclusions Mar 09 01:18:11:332 [Data Collector - JPTOKSMVMPW01, vmware] vmware inventory alarm update completed in '160' milliseconds Mar 09 01:18:11:332 [Data Collector - JPTOKSMVMPW01, vmware] PERF: Memory Status: Max=1499 CurrentAllocated=1499 Free=965 Used=534 MB Mar 09 01:18:11:332 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Finding Device Deltas Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Finding Device Deltas {Seconds=0.083} Finished finding Device Deltas. Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] Total inventory monitored: 697 nodes. Inventory count by type: {VIRTUAL_DISK=>28, VM_POWER=>12, HOST_SYSTEM=>200, VM_CPU_AGGREGATE=>12, VIRTUAL_DISK_AGGREGATE=>12, VM_NIC=>84, TEMPLATE=>3, HOST_NIC=>12, HOST_MEMORY=>2, HOST=>2, HOST_DISK=>4, VM=>12, VM_MEMORY=>12, VM_CPU=>43, VM_DATASTORE=>12, VM_DISK=>12, HOST_DISK_AGGREGATE=>2, HOST_DATASTORE=>6, DATACENTER=>1, VM_DISK_AGGREGATE=>12, VM_DATASTORE_AGGREGATE=>12, HOST_VIRTUAL_SWITCH=>6, HOST_CPU=>112, HOST_RES_CPU=>2, VM_GUEST_DISK=>24, VM_RES_CPU=>12, DATASTORE_DISK=>3, VM_SYSTEM=>12, HOST_SERVICE=>2, VM_NIC_AGGREGATE=>12, DATASTORE=>5, RESOURCE=>1, CLUSTER_COMPUTE_RESOURCE=>1, HOST_CPU_AGGREGATE=>2, HOST_NIC_AGGREGATE=>2, RESOURCE_POOL=>1, NETWORK=>1, HOST_POWER=>2, HOST_DATASTORE_AGGREGATE=>2} Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Resolving Auto Monitors Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Resolving Auto Monitors {Seconds=0.000} Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: Memory Status: Max=1499 CurrentAllocated=1499 Free=887 Used=612 MB Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Sending qos for monitors Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Sending qos for monitors {Seconds=0.000} Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: Updating monitors in graph Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: Updating monitors in graph {Seconds=0.000} Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: START: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. {Seconds=0.000} Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DataCollector for JPTOKSMVMPW01 collected 17 monitors (auto=17, static=0) Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: DONE: ----- Pass-851 --- Data Collector Check Interval for: JPTOKSMVMPW01 {Seconds=5.245} Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] PERF: Memory Status: Max=1499 CurrentAllocated=1499 Free=885 Used=614 MB Mar 09 01:18:11:415 [Data Collector - JPTOKSMVMPW01, vmware] DataCollector for JPTOKSMVMPW01 finished collecting data Mar 09 01:18:11:462 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Updating perf metric exclusions {Seconds=0.132} Mar 09 01:18:11:462 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update perf metrics {Seconds=3.534} Mar 09 01:18:11:462 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update computed metrics Mar 09 01:18:11:796 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update computed metrics {Seconds=0.334} Mar 09 01:18:11:796 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Recreating nodes to update properties Mar 09 01:18:11:975 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Ashburn DC Mar 09 01:18:11:975 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Ashburn DC {Seconds=0.000} Mar 09 01:18:11:995 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: US_Ashburn Mar 09 01:18:11:997 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: US_Ashburn {Seconds=0.002} Mar 09 01:18:12:028 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Recreating nodes to update properties {Seconds=0.232} Mar 09 01:18:12:028 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Vmware inventory update for usashsmvcpvw01 {Seconds=5.620} Mar 09 01:18:12:028 [Data Collector - usashsmvcpvw01, vmware] vmware inventory alarm update started Mar 09 01:18:16:186 [Data Collector - usashsmvcpvw01, vmware] vmware inventory alarm update completed in '4158' milliseconds Mar 09 01:18:16:187 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1499 CurrentAllocated=1499 Free=667 Used=832 MB Mar 09 01:18:16:187 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Finding Device Deltas Mar 09 01:18:18:361 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Finding Device Deltas {Seconds=2.174} Finished finding Device Deltas. Mar 09 01:18:18:364 [Data Collector - usashsmvcpvw01, vmware] Total inventory monitored: 16056 nodes. Inventory count by type: {HOST_SYSTEM=>2079, VIRTUAL_DISK=>1045, VM_GUEST_DISK=>1284, VIRTUAL_DISK_AGGREGATE=>436, VM_SYSTEM=>436, VM_NIC=>3173, NETWORK=>46, VM_MEMORY=>436, VM_CPU=>1835, VM_RES_CPU=>436, VM=>457, VM_DATASTORE_AGGREGATE=>430, VM_DATASTORE=>452, VM_CPU_AGGREGATE=>436, VM_DISK_AGGREGATE=>436, VM_POWER=>436, VM_DISK=>66, VM_NIC_AGGREGATE=>429, DATASTORE_DISK=>41, HOST_DATASTORE=>373, HOST_POWER=>22, HOST_CPU_AGGREGATE=>22, HOST=>22, HOST_NIC_AGGREGATE=>22, TEMPLATE=>11, HOST_NIC=>128, HOST_CPU=>736, DATASTORE=>86, HOST_SERVICE=>22, HOST_DISK_AGGREGATE=>22, HOST_DATASTORE_AGGREGATE=>22, HOST_MEMORY=>22, HOST_VIRTUAL_SWITCH=>48, HOST_DISK=>70, RESOURCE_POOL=>7, CLUSTER_COMPUTE_RESOURCE=>7, HOST_RES_CPU=>22, DATACENTER=>2, RESOURCE=>1} Mar 09 01:18:18:364 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Resolving Auto Monitors Mar 09 01:18:18:374 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Resolving Auto Monitors {Seconds=0.010} Mar 09 01:18:18:376 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1497 CurrentAllocated=1497 Free=776 Used=721 MB Mar 09 01:18:18:377 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Sending qos for monitors Mar 09 01:18:18:379 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Sending qos for monitors {Seconds=0.002} Mar 09 01:18:18:379 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Updating monitors in graph Mar 09 01:18:18:389 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Updating monitors in graph {Seconds=0.010} Mar 09 01:18:18:389 [Data Collector - usashsmvcpvw01, vmware] PERF: START: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. Mar 09 01:18:18:389 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. {Seconds=0.000} Mar 09 01:18:18:389 [Data Collector - usashsmvcpvw01, vmware] PERF: DataCollector for usashsmvcpvw01 collected 218 monitors (auto=218, static=0) Mar 09 01:18:18:389 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: ----- Pass-1701 --- Data Collector Check Interval for: usashsmvcpvw01 {Seconds=12.220} Mar 09 01:18:18:389 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1497 CurrentAllocated=1497 Free=766 Used=731 MB Mar 09 01:18:18:390 [Data Collector - usashsmvcpvw01, vmware] DataCollector for usashsmvcpvw01 finished collecting data Mar 09 01:19:21:170 [Data Collector - usmemsmvcpvw01, vmware] DataCollector for usmemsmvcpvw01 collecting data Mar 09 01:19:21:170 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: ----- Pass-1701 --- Data Collector Check Interval for: usmemsmvcpvw01 Mar 09 01:19:21:170 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1497 CurrentAllocated=1497 Free=726 Used=771 MB Mar 09 01:19:21:219 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Vmware setup graph with resource usmemsmvcpvw01 Mar 09 01:19:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Vmware setup graph with resource usmemsmvcpvw01 {Seconds=0.007} Mar 09 01:19:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Vmware inventory update for usmemsmvcpvw01 Mar 09 01:19:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Check for topology updates: https://usmemsmvcpvw01:443/sdk Mar 09 01:19:21:255 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Check for topology updates: https://usmemsmvcpvw01:443/sdk {Seconds=0.029} Mar 09 01:19:21:255 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Apply update Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-84226 Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-84226 {Seconds=0.000} Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-492 Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-492 {Seconds=0.000} Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-460 Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-460 {Seconds=0.000} Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-164361 Mar 09 01:19:21:256 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-164361 {Seconds=0.000} Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-684 Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-684 {Seconds=0.000} Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-489 Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-489 {Seconds=0.000} Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-84227 Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-84227 {Seconds=0.000} Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Apply update {Seconds=0.001} Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] 0 VMs filtered out from inventory Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1497 CurrentAllocated=1497 Free=725 Used=772 MB Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update property metrics Mar 09 01:19:21:257 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Check for property updates: https://usmemsmvcpvw01:443/sdk Mar 09 01:19:21:302 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Check for property updates: https://usmemsmvcpvw01:443/sdk {Seconds=0.045} Mar 09 01:19:21:302 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Apply property updates Mar 09 01:19:21:302 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Apply property updates {Seconds=0.000} Mar 09 01:19:21:302 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Check for quick stat updates: https://usmemsmvcpvw01:443/sdk Mar 09 01:19:21:792 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Check for quick stat updates: https://usmemsmvcpvw01:443/sdk {Seconds=0.490} Mar 09 01:19:21:792 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Apply quick stat updates Mar 09 01:19:21:803 [Data Collector - usmemsmvcpvw01, vmware] Skipped caching property values for vm-111191 due to an empty key Mar 09 01:19:21:808 [Data Collector - usmemsmvcpvw01, vmware] Skipped caching property values for vm-111189 due to an empty key Mar 09 01:19:21:808 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Apply quick stat updates {Seconds=0.016} Mar 09 01:19:21:808 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update property values in graph Mar 09 01:19:22:024 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update property values in graph {Seconds=0.216} Mar 09 01:19:22:024 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update property metrics {Seconds=0.767} Mar 09 01:19:22:024 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1497 CurrentAllocated=1497 Free=592 Used=905 MB Mar 09 01:19:22:024 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update array values in graph Mar 09 01:19:22:040 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update array values in graph {Seconds=0.016} Mar 09 01:19:22:040 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1497 CurrentAllocated=1497 Free=588 Used=909 MB Mar 09 01:19:22:096 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update perf metrics Mar 09 01:19:22:222 [Performance Metric Collection - 20, vmware] Batch fetching of perf metrics failed. Retrying as individual requests Mar 09 01:19:22:801 [Performance Metric Collection - 20, vmware] Failed to execute single perf query for entity resgroup-239. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:19:23:548 [Performance Metric Collection - 20, vmware] Failed to execute single perf query for entity resgroup-47. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:19:28:155 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Updating perf metric exclusions Mar 09 01:19:28:277 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Updating perf metric exclusions {Seconds=0.122} Mar 09 01:19:28:278 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update perf metrics {Seconds=6.182} Mar 09 01:19:28:288 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update computed metrics Mar 09 01:19:28:532 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update computed metrics {Seconds=0.244} Mar 09 01:19:28:532 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Recreating nodes to update properties Mar 09 01:19:28:548 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Brazil DC Mar 09 01:19:28:548 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Brazil DC {Seconds=0.000} Mar 09 01:19:28:564 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Colombia DC Mar 09 01:19:28:564 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Colombia DC {Seconds=0.000} Mar 09 01:19:28:564 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Oklahoma DC Mar 09 01:19:28:564 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Oklahoma DC {Seconds=0.000} Mar 09 01:19:28:564 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Mansfield DC Mar 09 01:19:28:564 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Mansfield DC {Seconds=0.000} Mar 09 01:19:28:657 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Puerto Rico DC Mar 09 01:19:28:657 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Puerto Rico DC {Seconds=0.000} Mar 09 01:19:28:720 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Memphis DC Mar 09 01:19:28:720 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Memphis DC {Seconds=0.000} Mar 09 01:19:28:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: San Clemente Mar 09 01:19:28:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: San Clemente {Seconds=0.000} Mar 09 01:19:28:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Costa Rica DC Mar 09 01:19:28:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Costa Rica DC {Seconds=0.000} Mar 09 01:19:28:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Recreating nodes to update properties {Seconds=0.250} Mar 09 01:19:28:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Vmware inventory update for usmemsmvcpvw01 {Seconds=7.556} Mar 09 01:19:28:782 [Data Collector - usmemsmvcpvw01, vmware] vmware inventory alarm update started Mar 09 01:19:28:898 [Data Collector - usmemsmvcpvw01, vmware] vmware inventory alarm update completed in '116' milliseconds Mar 09 01:19:28:898 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=935 Used=566 MB Mar 09 01:19:28:899 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Finding Device Deltas Mar 09 01:19:30:763 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Finding Device Deltas {Seconds=1.864} Finished finding Device Deltas. Mar 09 01:19:30:766 [Data Collector - usmemsmvcpvw01, vmware] Total inventory monitored: 14518 nodes. Inventory count by type: {HOST_SYSTEM=>2818, VM_DATASTORE_AGGREGATE=>259, VM_CPU_AGGREGATE=>273, HOST_DISK=>403, VM_NIC_AGGREGATE=>253, VM_NIC=>2578, VM_GUEST_DISK=>838, HOST_MEMORY=>32, VIRTUAL_DISK=>778, VM_DATASTORE=>286, DATASTORE_DISK=>84, VM_MEMORY=>273, HOST_DISK_AGGREGATE=>32, VM_POWER=>273, VM_SYSTEM=>273, VM=>333, HOST_CPU=>1356, VM_CPU=>1183, VM_DISK_AGGREGATE=>273, VM_RES_CPU=>273, HOST_CPU_AGGREGATE=>32, HOST_DATASTORE=>332, VIRTUAL_DISK_AGGREGATE=>273, VM_DISK=>329, NETWORK=>36, HOST_POWER=>32, RESOURCE_POOL=>12, HOST_NIC=>274, HOST=>32, HOST_SERVICE=>32, HOST_NIC_AGGREGATE=>32, DATASTORE=>79, TEMPLATE=>8, HOST_VIRTUAL_SWITCH=>58, DV_PORTGROUP=>1, HOST_RES_CPU=>32, DATACENTER=>8, HOST_DATASTORE_AGGREGATE=>32, CLUSTER_COMPUTE_RESOURCE=>11, RESOURCE=>1, COMPUTE_RESOURCE=>1} Mar 09 01:19:30:766 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Resolving Auto Monitors Mar 09 01:19:30:776 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Resolving Auto Monitors {Seconds=0.010} Mar 09 01:19:30:779 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=684 Used=817 MB Mar 09 01:19:30:779 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Sending qos for monitors Mar 09 01:19:30:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Sending qos for monitors {Seconds=0.003} Mar 09 01:19:30:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Updating monitors in graph Mar 09 01:19:30:796 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Updating monitors in graph {Seconds=0.014} Mar 09 01:19:30:796 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. Mar 09 01:19:30:796 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. {Seconds=0.000} Mar 09 01:19:30:796 [Data Collector - usmemsmvcpvw01, vmware] PERF: DataCollector for usmemsmvcpvw01 collected 271 monitors (auto=271, static=0) Mar 09 01:19:30:796 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: ----- Pass-1701 --- Data Collector Check Interval for: usmemsmvcpvw01 {Seconds=9.626} Mar 09 01:19:30:796 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=675 Used=826 MB Mar 09 01:19:30:796 [Data Collector - usmemsmvcpvw01, vmware] DataCollector for usmemsmvcpvw01 finished collecting data Mar 09 01:20:36:172 [Data Collector - USMEM-SMVCPVW01, vmware] DataCollector for USMEM-SMVCPVW01 collecting data Mar 09 01:20:36:172 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: ----- Pass-1702 --- Data Collector Check Interval for: USMEM-SMVCPVW01 Mar 09 01:20:36:172 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=647 Used=854 MB Mar 09 01:20:36:179 [Data Collector - zabus, vmware] DataCollector for zabus collecting data Mar 09 01:20:36:179 [Data Collector - zabus, vmware] PERF: START: ----- Pass-851 --- Data Collector Check Interval for: zabus Mar 09 01:20:36:179 [Data Collector - zabus, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=641 Used=860 MB Mar 09 01:20:36:385 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Vmware setup graph with resource USMEM-SMVCPVW01 Mar 09 01:20:36:387 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Vmware setup graph with resource USMEM-SMVCPVW01 {Seconds=0.002} Mar 09 01:20:36:387 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Vmware inventory update for USMEM-SMVCPVW01 Mar 09 01:20:36:388 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Check for topology updates: https://USMEM-SMVCPVW01:443/sdk Mar 09 01:20:36:390 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Check for topology updates: https://USMEM-SMVCPVW01:443/sdk {Seconds=0.002} Mar 09 01:20:36:390 [Data Collector - USMEM-SMVCPVW01, vmware] 0 VMs filtered out from inventory Mar 09 01:20:36:390 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=568 Used=933 MB Mar 09 01:20:36:390 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Update property metrics Mar 09 01:20:36:390 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Check for property updates: https://USMEM-SMVCPVW01:443/sdk Mar 09 01:20:36:393 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Check for property updates: https://USMEM-SMVCPVW01:443/sdk {Seconds=0.003} Mar 09 01:20:36:393 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Apply property updates Mar 09 01:20:36:393 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Apply property updates {Seconds=0.000} Mar 09 01:20:36:393 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Check for quick stat updates: https://USMEM-SMVCPVW01:443/sdk Mar 09 01:20:36:606 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Check for quick stat updates: https://USMEM-SMVCPVW01:443/sdk {Seconds=0.213} Mar 09 01:20:36:607 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Apply quick stat updates Mar 09 01:20:36:607 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Apply quick stat updates {Seconds=0.000} Mar 09 01:20:36:607 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Update property values in graph Mar 09 01:20:36:627 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Update property values in graph {Seconds=0.020} Mar 09 01:20:36:628 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Update property metrics {Seconds=0.238} Mar 09 01:20:36:628 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=558 Used=943 MB Mar 09 01:20:36:628 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Update array values in graph Mar 09 01:20:36:630 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Update array values in graph {Seconds=0.002} Mar 09 01:20:36:630 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: Memory Status: Max=1501 CurrentAllocated=1501 Free=558 Used=943 MB Mar 09 01:20:36:711 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: Update perf metrics Mar 09 01:20:36:844 [Performance Metric Collection - 18, vmware] Batch fetching of perf metrics failed. Retrying as individual requests Mar 09 01:20:36:863 [Performance Metric Collection - 18, vmware] Failed to execute single perf query for entity resgroup-6875. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:20:37:528 [Data Collector - zabus, vmware] PERF: START: Vmware setup graph with resource zabus Mar 09 01:20:37:821 [Data Collector - zabus, vmware] PERF: DONE: Vmware setup graph with resource zabus {Seconds=0.293} Mar 09 01:20:37:821 [Data Collector - zabus, vmware] PERF: START: Vmware inventory update for zabus Mar 09 01:20:37:822 [Data Collector - zabus, vmware] PERF: START: Check for topology updates: https://zabus:443/sdk Mar 09 01:20:38:114 [Data Collector - zabus, vmware] PERF: DONE: Check for topology updates: https://zabus:443/sdk {Seconds=0.292} Mar 09 01:20:38:114 [Data Collector - zabus, vmware] 0 VMs filtered out from inventory Mar 09 01:20:38:114 [Data Collector - zabus, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=902 Used=601 MB Mar 09 01:20:38:114 [Data Collector - zabus, vmware] PERF: START: Update property metrics Mar 09 01:20:38:114 [Data Collector - zabus, vmware] PERF: START: Check for property updates: https://zabus:443/sdk Mar 09 01:20:38:407 [Data Collector - zabus, vmware] PERF: DONE: Check for property updates: https://zabus:443/sdk {Seconds=0.293} Mar 09 01:20:38:407 [Data Collector - zabus, vmware] PERF: START: Apply property updates Mar 09 01:20:38:407 [Data Collector - zabus, vmware] PERF: DONE: Apply property updates {Seconds=0.000} Mar 09 01:20:38:407 [Data Collector - zabus, vmware] PERF: START: Check for quick stat updates: https://zabus:443/sdk Mar 09 01:20:39:699 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:1).Disk Total Write Latency' Mar 09 01:20:39:699 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:1).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:1"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:699 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:3).Disk Total Write Latency' Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:3).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:3"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:1).Disk Total Read Latency' Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:1).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:1"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:3).Disk Total Read Latency' Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:3).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:3"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:0).Disk Total Write Latency' Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:0).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:0"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:700 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:2).Disk Total Write Latency' Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:2).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:2"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:0).Disk Total Read Latency' Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:0).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d5b0-db35-8bcf-f2d7-2503fe364ff0:Virtual Disks:scsi0:0"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:2).Disk Total Read Latency' Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:2).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:2"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:1).Disk Total Write Latency' Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:1).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:1"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:1).Disk Total Write Latency' Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:1).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:1"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:701 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:1).Disk Total Read Latency' Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:1).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:1"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:1).Disk Total Read Latency' Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:1).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005b431-397f-87c7-80d0-1ba275d2e763:Virtual Disks:scsi0:1"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:0).Disk Total Write Latency' Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:0).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:0"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:0).Disk Total Read Latency' Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:0).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005d58b-d35e-e13e-fc75-ef1202519ab7:Virtual Disks:scsi0:0"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VM_NIC_AGGREGATE (USMEM-SMVCPVW01:502d4874-733c-3bac-bbd3-f5227c16fcbd:Network).Network Receive Packets Dropped' Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VM_NIC_AGGREGATE (USMEM-SMVCPVW01:502d4874-733c-3bac-bbd3-f5227c16fcbd:Network).Network Receive Packets Dropped'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VM_NIC_AGGREGATE:USMEM-SMVCPVW01:502d4874-733c-3bac-bbd3-f5227c16fcbd:Network"."droppedRx"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:702 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VM_NIC_AGGREGATE (USMEM-SMVCPVW01:5012deb5-4e2f-457e-9e52-b1ba15fbb1dc:Network).Network usage' Mar 09 01:20:39:703 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VM_NIC_AGGREGATE (USMEM-SMVCPVW01:5012deb5-4e2f-457e-9e52-b1ba15fbb1dc:Network).Network usage'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VM_NIC_AGGREGATE:USMEM-SMVCPVW01:5012deb5-4e2f-457e-9e52-b1ba15fbb1dc:Network"."usage"'. Monitor vertex will not be added to inventory Mar 09 01:20:39:703 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VM_NIC_AGGREGATE (USMEM-SMVCPVW01:5005f3dc-52dd-5b4f-5a2c-fbf4d27de765:Network).Network Transmit Packets Dropped' Mar 09 01:20:40:621 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:1).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:1"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:40:621 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:0).Disk Total Write Latency' Mar 09 01:20:40:621 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:0).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:0"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:40:621 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:0).Disk Total Read Latency' Mar 09 01:20:40:621 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:0).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:0"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:40:622 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:1).Disk Total Write Latency' Mar 09 01:20:40:622 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:1).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:1"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:40:622 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:1).Disk Total Read Latency' Mar 09 01:20:40:622 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:1).Disk Total Read Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:1"."totalReadLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:40:622 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:0).Disk Total Write Latency' Mar 09 01:20:40:622 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:0).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005a0b7-7d33-17d4-62d3-e75cb360ec73:Virtual Disks:scsi0:0"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:40:624 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: Updating monitors in graph {Seconds=1.152} Mar 09 01:20:40:624 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: START: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. Mar 09 01:20:40:624 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. {Seconds=0.000} Mar 09 01:20:40:624 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DataCollector for USMEM-SMVCPVW01 collected 381 monitors (auto=43, static=338) Mar 09 01:20:40:624 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: DONE: ----- Pass-1702 --- Data Collector Check Interval for: USMEM-SMVCPVW01 {Seconds=4.452} Mar 09 01:20:40:624 [Data Collector - USMEM-SMVCPVW01, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=881 Used=613 MB Mar 09 01:20:40:624 [Data Collector - USMEM-SMVCPVW01, vmware] DataCollector for USMEM-SMVCPVW01 finished collecting data Mar 09 01:20:40:621 [Data Collector - USMEM-SMVCPVW01, vmware] Failed to collect data for monitor 'VIRTUAL_DISK (USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:1).Disk Total Write Latency'. Updated value will not be available.: Inventory lookup failed for parent of '"ESC:VIRTUAL_DISK:USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:1"."totalWriteLatency"'. Monitor vertex will not be added to inventory Mar 09 01:20:40:621 [Data Collector - USMEM-SMVCPVW01, vmware] ERROR was caught when adding mondef properties to graph monitor. The following should not be null but is: 'monitor qos def' for monitor VIRTUAL_DISK (USMEM-SMVCPVW01:5005a198-f3a6-c098-e560-830c6915ff5f:Virtual Disks:scsi0:1).Disk Total Read Latency' Mar 09 01:20:43:307 [Data Collector - zabus, vmware] PERF: START: Update perf metrics Mar 09 01:20:44:522 [Performance Metric Collection - 8, vmware] Batch fetching of perf metrics failed. Retrying as individual requests Mar 09 01:20:44:826 [Performance Metric Collection - 8, vmware] Failed to execute single perf query for entity resgroup-8. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:20:45:135 [Performance Metric Collection - 8, vmware] Failed to execute single perf query for entity resgroup-7702. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:20:50:998 [Data Collector - zabus, vmware] PERF: START: Updating perf metric exclusions Mar 09 01:20:51:006 [Data Collector - zabus, vmware] PERF: DONE: Updating perf metric exclusions {Seconds=0.008} Mar 09 01:20:51:006 [Data Collector - zabus, vmware] PERF: DONE: Update perf metrics {Seconds=7.698} Mar 09 01:20:51:007 [Data Collector - zabus, vmware] PERF: START: Update computed metrics Mar 09 01:20:51:024 [Data Collector - zabus, vmware] PERF: DONE: Update computed metrics {Seconds=0.017} Mar 09 01:20:51:024 [Data Collector - zabus, vmware] PERF: START: Recreating nodes to update properties Mar 09 01:20:51:030 [Data Collector - zabus, vmware] PERF: START: Update properties from DataCenter: ZASN Mar 09 01:20:51:030 [Data Collector - zabus, vmware] PERF: DONE: Update properties from DataCenter: ZASN {Seconds=0.000} Mar 09 01:20:51:036 [Data Collector - zabus, vmware] PERF: DONE: Recreating nodes to update properties {Seconds=0.012} Mar 09 01:20:51:036 [Data Collector - zabus, vmware] PERF: DONE: Vmware inventory update for zabus {Seconds=13.215} Mar 09 01:20:51:036 [Data Collector - zabus, vmware] vmware inventory alarm update started Mar 09 01:20:55:448 [Data Collector - zabus, vmware] vmware inventory alarm update completed in '4412' milliseconds Mar 09 01:20:55:449 [Data Collector - zabus, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=742 Used=752 MB Mar 09 01:20:55:449 [Data Collector - zabus, vmware] PERF: START: Finding Device Deltas Mar 09 01:20:55:570 [Data Collector - zabus, vmware] PERF: DONE: Finding Device Deltas {Seconds=0.121} Finished finding Device Deltas. Mar 09 01:20:55:570 [Data Collector - zabus, vmware] Total inventory monitored: 988 nodes. Inventory count by type: {VIRTUAL_DISK_AGGREGATE=>19, VIRTUAL_DISK=>34, VM_DISK_AGGREGATE=>19, HOST_DISK=>42, HOST_SYSTEM=>237, VM_GUEST_DISK=>44, HOST_SERVICE=>3, VM=>21, VM_DATASTORE=>17, VM_DISK=>30, VM_CPU_AGGREGATE=>19, VM_MEMORY=>19, VM_NIC_AGGREGATE=>16, NETWORK=>5, HOST=>3, VM_NIC=>114, HOST_VIRTUAL_SWITCH=>12, VM_POWER=>19, VM_SYSTEM=>19, VM_RES_CPU=>19, HOST_DISK_AGGREGATE=>3, DATASTORE=>14, HOST_DATASTORE_AGGREGATE=>3, VM_CPU=>64, DATASTORE_DISK=>12, HOST_NIC_AGGREGATE=>3, HOST_POWER=>3, HOST_DATASTORE=>36, VM_DATASTORE_AGGREGATE=>16, HOST_NIC=>20, HOST_CPU=>88, HOST_CPU_AGGREGATE=>3, COMPUTE_RESOURCE=>1, HOST_RES_CPU=>3, DATACENTER=>1, RESOURCE_POOL=>2, CLUSTER_COMPUTE_RESOURCE=>1, HOST_MEMORY=>3, RESOURCE=>1} Mar 09 01:20:55:570 [Data Collector - zabus, vmware] PERF: START: Resolving Auto Monitors Mar 09 01:20:55:571 [Data Collector - zabus, vmware] PERF: DONE: Resolving Auto Monitors {Seconds=0.001} Mar 09 01:20:55:572 [Data Collector - zabus, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=694 Used=800 MB Mar 09 01:20:55:572 [Data Collector - zabus, vmware] PERF: START: Sending qos for monitors Mar 09 01:20:55:572 [Data Collector - zabus, vmware] PERF: DONE: Sending qos for monitors {Seconds=0.000} Mar 09 01:20:55:572 [Data Collector - zabus, vmware] PERF: START: Updating monitors in graph Mar 09 01:20:55:574 [Data Collector - zabus, vmware] PERF: DONE: Updating monitors in graph {Seconds=0.002} Mar 09 01:20:55:574 [Data Collector - zabus, vmware] PERF: START: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. Mar 09 01:20:55:574 [Data Collector - zabus, vmware] PERF: DONE: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. {Seconds=0.000} Mar 09 01:20:55:574 [Data Collector - zabus, vmware] PERF: DataCollector for zabus collected 32 monitors (auto=32, static=0) Mar 09 01:20:55:574 [Data Collector - zabus, vmware] PERF: DONE: ----- Pass-851 --- Data Collector Check Interval for: zabus {Seconds=19.395} Mar 09 01:20:55:574 [Data Collector - zabus, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=693 Used=801 MB Mar 09 01:20:55:574 [Data Collector - zabus, vmware] DataCollector for zabus finished collecting data Mar 09 01:21:51:174 [Data Collector - USASHSMINPVW01, vmware] DataCollector for USASHSMINPVW01 collecting data Mar 09 01:21:51:174 [Data Collector - USASHSMINPVW01, vmware] PERF: START: ----- Pass-1702 --- Data Collector Check Interval for: USASHSMINPVW01 Mar 09 01:21:51:174 [Data Collector - USASHSMINPVW01, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=643 Used=851 MB Mar 09 01:21:55:481 [Data Collector - USASHSMINPVW01, vmware] isVmwareApiAvailable() failed: Mar 09 01:21:55:481 [Data Collector - USASHSMINPVW01, vmware] (12) login failed, VMWare API is unavailable: Cannot complete login due to an incorrect user name or password.: Cannot complete login due to an incorrect user name or password. at com.nimsoft.probe.application.vmware.sdk.VmwareEnvAdaptor.login(VmwareEnvAdaptor.java:273) at com.nimsoft.probe.application.vmware.sdk.VmwareEnvAdaptor.relogin(VmwareEnvAdaptor.java:1215) at com.nimsoft.probe.application.vmware.sdk.VmwareEnvAdaptor.isVmwareApiAvailable(VmwareEnvAdaptor.java:1157) at com.nimsoft.probe.application.vmware.sdk.VmwareSession.updateInventory(VmwareSession.java:161) Caused by: com.vmware.vim25.InvalidLogin: Cannot complete login due to an incorrect user name or password. at sun.reflect.GeneratedConstructorAccessor181.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at java.lang.Class.newInstance(Class.java:442) at com.vmware.vim25.ws.XmlGenDom.fromXml(XmlGenDom.java:246) at com.vmware.vim25.ws.XmlGenDom.parseSoapFault(XmlGenDom.java:149) at com.vmware.vim25.ws.XmlGenDom.fromXML(XmlGenDom.java:107) at com.vmware.vim25.ws.SoapClient.unMarshall(SoapClient.java:253) at com.vmware.vim25.ws.WSClient.invoke(WSClient.java:96) at com.vmware.vim25.ws.VimStub.login(VimStub.java:1732) at com.vmware.vim25.mo.SessionManager.login(SessionManager.java:153) at com.vmware.vim25.mo.ServiceInstance.login(ServiceInstance.java:238) at com.vmware.vim25.mo.ServiceInstance.constructServiceInstance(ServiceInstance.java:131) Mar 09 01:21:55:481 [Data Collector - USASHSMINPVW01, vmware] PERF: START: Vmware setup graph with resource USASHSMINPVW01 Mar 09 01:21:55:482 [Data Collector - USASHSMINPVW01, vmware] PERF: DONE: Vmware setup graph with resource USASHSMINPVW01 {Seconds=0.001} Mar 09 01:21:55:482 [Data Collector - USASHSMINPVW01, vmware] Inventory update failed. Sending resource alarm Mar 09 01:21:55:482 [Data Collector - USASHSMINPVW01, vmware] (12) login failed, VMWare API is unavailable. Mar 09 01:21:55:483 [Data Collector - USASHSMINPVW01, vmware] PERF: DONE: ----- Pass-1702 --- Data Collector Check Interval for: USASHSMINPVW01 {Seconds=4.309} Mar 09 01:21:55:483 [Data Collector - USASHSMINPVW01, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=640 Used=854 MB Mar 09 01:21:55:483 [Data Collector - USASHSMINPVW01, vmware] DataCollector for USASHSMINPVW01 finished collecting data Mar 09 01:22:11:722 [attach_socket, vmware] cbVerifyResource failed Mar 09 01:22:11:723 [attach_socket, vmware] (12) login failed, VMWare API is unavailable: Cannot complete login due to an incorrect user name or password.: Cannot complete login due to an incorrect user name or password. at com.nimsoft.probe.application.vmware.sdk.VmwareSession.login(VmwareSession.java:129) at com.nimsoft.probe.application.vmware.sdk.VmwareSession.testConnection(VmwareSession.java:152) at com.nimsoft.probe.common.ctd.AbstractCtdProbeCallbackHandler.connect(AbstractCtdProbeCallbackHandler.java:1373) at com.nimsoft.vm.BaseCallbackHandler.cbVerifyResource(BaseCallbackHandler.java:183) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.nimsoft.nimbus.NimServerSession$NimServerSessionThread.performCallback(NimServerSession.java:225) at com.nimsoft.nimbus.NimServerSession$NimServerSessionThread.handleMessage(NimServerSession.java:178) at com.nimsoft.nimbus.NimServerSession$NimServerSessionThread.run(NimServerSession.java:123) ... 11 more Mar 09 01:23:06:175 [Data Collector - usashsmvcpvw01, vmware] DataCollector for usashsmvcpvw01 collecting data Mar 09 01:23:06:175 [Data Collector - usashsmvcpvw01, vmware] PERF: START: ----- Pass-1702 --- Data Collector Check Interval for: usashsmvcpvw01 Mar 09 01:23:06:175 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=580 Used=914 MB Mar 09 01:23:06:176 [Data Collector - 172.20.16.53, vmware] DataCollector for 172.20.16.53 collecting data Mar 09 01:23:06:176 [Data Collector - 172.20.16.53, vmware] PERF: START: ----- Pass-851 --- Data Collector Check Interval for: 172.20.16.53 Mar 09 01:23:06:176 [Data Collector - 172.20.16.53, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=580 Used=914 MB Mar 09 01:23:06:340 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Vmware setup graph with resource usashsmvcpvw01 Mar 09 01:23:06:379 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Vmware setup graph with resource usashsmvcpvw01 {Seconds=0.039} Mar 09 01:23:06:379 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Vmware inventory update for usashsmvcpvw01 Mar 09 01:23:06:379 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Check for topology updates: https://usashsmvcpvw01:443/sdk Mar 09 01:23:06:417 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Check for topology updates: https://usashsmvcpvw01:443/sdk {Seconds=0.038} Mar 09 01:23:06:417 [Data Collector - usashsmvcpvw01, vmware] 0 VMs filtered out from inventory Mar 09 01:23:06:417 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1494 CurrentAllocated=1494 Free=578 Used=916 MB Mar 09 01:23:06:417 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update property metrics Mar 09 01:23:06:417 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Check for property updates: https://usashsmvcpvw01:443/sdk Mar 09 01:23:06:496 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Check for property updates: https://usashsmvcpvw01:443/sdk {Seconds=0.079} Mar 09 01:23:06:496 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Apply property updates Mar 09 01:23:06:496 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Apply property updates {Seconds=0.000} Mar 09 01:23:06:496 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Check for quick stat updates: https://usashsmvcpvw01:443/sdk Mar 09 01:23:07:423 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Check for quick stat updates: https://usashsmvcpvw01:443/sdk {Seconds=0.927} Mar 09 01:23:07:423 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Apply quick stat updates Mar 09 01:23:07:438 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Apply quick stat updates {Seconds=0.015} Mar 09 01:23:07:438 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update property values in graph Mar 09 01:23:07:768 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update property values in graph {Seconds=0.330} Mar 09 01:23:07:768 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update property metrics {Seconds=1.351} Mar 09 01:23:07:768 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1487 CurrentAllocated=1487 Free=852 Used=635 MB Mar 09 01:23:07:768 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update array values in graph Mar 09 01:23:07:787 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update array values in graph {Seconds=0.019} Mar 09 01:23:07:787 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1487 CurrentAllocated=1487 Free=847 Used=640 MB Mar 09 01:23:07:869 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update perf metrics Mar 09 01:23:08:152 [Performance Metric Collection - 31, vmware] Batch fetching of perf metrics failed. Retrying as individual requests Mar 09 01:23:08:277 [Performance Metric Collection - 31, vmware] Failed to execute single perf query for entity resgroup-786. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:23:08:335 [Performance Metric Collection - 31, vmware] Failed to execute single perf query for entity resgroup-65241. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:23:08:620 [Performance Metric Collection - 31, vmware] Failed to execute single perf query for entity resgroup-43. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:23:10:057 [Data Collector - 172.20.16.53, vmware] isVmwareApiAvailable() failed: Mar 09 01:23:10:058 [Data Collector - 172.20.16.53, vmware] (12) login failed, VMWare API is unavailable: Cannot complete login due to an incorrect user name or password.: Cannot complete login due to an incorrect user name or password. Mar 09 01:23:10:058 [Data Collector - 172.20.16.53, vmware] PERF: START: Vmware setup graph with resource 172.20.16.53 Mar 09 01:23:10:059 [Data Collector - 172.20.16.53, vmware] PERF: DONE: Vmware setup graph with resource 172.20.16.53 {Seconds=0.001} Mar 09 01:23:10:059 [Data Collector - 172.20.16.53, vmware] Inventory update failed. Sending resource alarm Mar 09 01:23:10:059 [Data Collector - 172.20.16.53, vmware] (12) login failed, VMWare API is unavailable. Mar 09 01:23:10:059 [Data Collector - 172.20.16.53, vmware] PERF: DONE: ----- Pass-851 --- Data Collector Check Interval for: 172.20.16.53 {Seconds=3.883} Mar 09 01:23:10:059 [Data Collector - 172.20.16.53, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=770 Used=733 MB Mar 09 01:23:10:059 [Data Collector - 172.20.16.53, vmware] DataCollector for 172.20.16.53 finished collecting data Mar 09 01:23:11:125 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Updating perf metric exclusions Mar 09 01:23:11:250 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Updating perf metric exclusions {Seconds=0.125} Mar 09 01:23:11:250 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update perf metrics {Seconds=3.381} Mar 09 01:23:11:266 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update computed metrics Mar 09 01:23:11:602 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update computed metrics {Seconds=0.336} Mar 09 01:23:11:603 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Recreating nodes to update properties Mar 09 01:23:11:770 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Ashburn DC Mar 09 01:23:11:770 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Ashburn DC {Seconds=0.000} Mar 09 01:23:11:790 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: US_Ashburn Mar 09 01:23:11:792 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: US_Ashburn {Seconds=0.002} Mar 09 01:23:11:821 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Recreating nodes to update properties {Seconds=0.218} Mar 09 01:23:11:821 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Vmware inventory update for usashsmvcpvw01 {Seconds=5.442} Mar 09 01:23:11:821 [Data Collector - usashsmvcpvw01, vmware] vmware inventory alarm update started Mar 09 01:23:16:394 [Data Collector - usashsmvcpvw01, vmware] vmware inventory alarm update completed in '4573' milliseconds Mar 09 01:23:16:394 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1504 CurrentAllocated=1504 Free=573 Used=931 MB Mar 09 01:23:16:394 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Finding Device Deltas Mar 09 01:23:18:649 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Finding Device Deltas {Seconds=2.255} Finished finding Device Deltas. Mar 09 01:23:18:653 [Data Collector - usashsmvcpvw01, vmware] Total inventory monitored: 16056 nodes. Mar 09 01:23:18:653 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Resolving Auto Monitors Mar 09 01:23:18:663 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Resolving Auto Monitors {Seconds=0.010} Mar 09 01:23:18:666 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=704 Used=799 MB Mar 09 01:23:18:666 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Sending qos for monitors Mar 09 01:23:18:668 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Sending qos for monitors {Seconds=0.002} Mar 09 01:23:18:668 [Data Collector - usashsmvcpvw01, vmware] PERF: START: Updating monitors in graph Mar 09 01:23:18:678 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: Updating monitors in graph {Seconds=0.010} Mar 09 01:23:18:678 [Data Collector - usashsmvcpvw01, vmware] PERF: START: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. Mar 09 01:23:18:678 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. {Seconds=0.000} Mar 09 01:23:18:679 [Data Collector - usashsmvcpvw01, vmware] PERF: DataCollector for usashsmvcpvw01 collected 218 monitors (auto=218, static=0) Mar 09 01:23:18:679 [Data Collector - usashsmvcpvw01, vmware] PERF: DONE: ----- Pass-1702 --- Data Collector Check Interval for: usashsmvcpvw01 {Seconds=12.504} Mar 09 01:23:18:679 [Data Collector - usashsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=694 Used=809 MB Mar 09 01:23:18:679 [Data Collector - usashsmvcpvw01, vmware] DataCollector for usashsmvcpvw01 finished collecting data Mar 09 01:24:21:179 [Data Collector - usmemsmvcpvw01, vmware] DataCollector for usmemsmvcpvw01 collecting data Mar 09 01:24:21:179 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: ----- Pass-1702 --- Data Collector Check Interval for: usmemsmvcpvw01 Mar 09 01:24:21:179 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=633 Used=870 MB Mar 09 01:24:21:208 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Vmware setup graph with resource usmemsmvcpvw01 Mar 09 01:24:21:216 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Vmware setup graph with resource usmemsmvcpvw01 {Seconds=0.008} Mar 09 01:24:21:216 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Vmware inventory update for usmemsmvcpvw01 Mar 09 01:24:21:216 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Check for topology updates: https://usmemsmvcpvw01:443/sdk Mar 09 01:24:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Check for topology updates: https://usmemsmvcpvw01:443/sdk {Seconds=0.010} Mar 09 01:24:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Apply update Mar 09 01:24:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-104 Mar 09 01:24:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-104 {Seconds=0.000} Mar 09 01:24:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-84225 Mar 09 01:24:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-84225 {Seconds=0.000} Mar 09 01:24:21:226 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Modify Node vm-604 Mar 09 01:24:21:227 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Modify Node vm-604 {Seconds=0.001} Mar 09 01:24:21:227 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Apply update {Seconds=0.001} Mar 09 01:24:21:227 [Data Collector - usmemsmvcpvw01, vmware] 0 VMs filtered out from inventory Mar 09 01:24:21:227 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=632 Used=871 MB Mar 09 01:24:21:227 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update property metrics Mar 09 01:24:21:227 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Check for property updates: https://usmemsmvcpvw01:443/sdk Mar 09 01:24:21:240 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Check for property updates: https://usmemsmvcpvw01:443/sdk {Seconds=0.013} Mar 09 01:24:21:240 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Apply property updates Mar 09 01:24:21:240 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Apply property updates {Seconds=0.000} Mar 09 01:24:21:240 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Check for quick stat updates: https://usmemsmvcpvw01:443/sdk Mar 09 01:24:21:749 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Check for quick stat updates: https://usmemsmvcpvw01:443/sdk {Seconds=0.508} Mar 09 01:24:21:749 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Apply quick stat updates Mar 09 01:24:21:766 [Data Collector - usmemsmvcpvw01, vmware] Skipped caching property values for vm-111191 due to an empty key Mar 09 01:24:21:782 [Data Collector - usmemsmvcpvw01, vmware] Skipped caching property values for vm-111189 due to an empty key Mar 09 01:24:21:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Apply quick stat updates {Seconds=0.033} Mar 09 01:24:21:782 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update property values in graph Mar 09 01:24:22:042 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update property values in graph {Seconds=0.260} Mar 09 01:24:22:042 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update property metrics {Seconds=0.815} Mar 09 01:24:22:042 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=500 Used=1003 MB Mar 09 01:24:22:042 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update array values in graph Mar 09 01:24:22:060 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update array values in graph {Seconds=0.018} Mar 09 01:24:22:060 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=496 Used=1007 MB Mar 09 01:24:22:120 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update perf metrics Mar 09 01:24:22:230 [Performance Metric Collection - 6, vmware] Batch fetching of perf metrics failed. Retrying as individual requests Mar 09 01:24:23:119 [Performance Metric Collection - 6, vmware] Failed to execute single perf query for entity resgroup-239. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:24:23:638 [Performance Metric Collection - 6, vmware] Failed to execute single perf query for entity resgroup-47. Max query size exceeded. Request processing is restricted by administrator (vpxd.stats.maxQueryMetrics). Follow VMware KB 2107096 to resolve. Mar 09 01:24:28:000 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Updating perf metric exclusions Mar 09 01:24:28:110 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Updating perf metric exclusions {Seconds=0.110} Mar 09 01:24:28:110 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update perf metrics {Seconds=5.990} Mar 09 01:24:28:125 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update computed metrics Mar 09 01:24:28:375 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update computed metrics {Seconds=0.250} Mar 09 01:24:28:375 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Recreating nodes to update properties Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Brazil DC Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Brazil DC {Seconds=0.000} Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Colombia DC Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Colombia DC {Seconds=0.000} Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Oklahoma DC Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Oklahoma DC {Seconds=0.000} Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Mansfield DC Mar 09 01:24:28:406 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Mansfield DC {Seconds=0.000} Mar 09 01:24:28:468 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Puerto Rico DC Mar 09 01:24:28:468 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Puerto Rico DC {Seconds=0.000} Mar 09 01:24:28:528 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Memphis DC Mar 09 01:24:28:530 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Memphis DC {Seconds=0.002} Mar 09 01:24:28:660 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: San Clemente Mar 09 01:24:28:661 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: San Clemente {Seconds=0.001} Mar 09 01:24:28:665 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Update properties from DataCenter: Costa Rica DC Mar 09 01:24:28:665 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Update properties from DataCenter: Costa Rica DC {Seconds=0.000} Mar 09 01:24:28:667 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Recreating nodes to update properties {Seconds=0.292} Mar 09 01:24:28:667 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Vmware inventory update for usmemsmvcpvw01 {Seconds=7.451} Mar 09 01:24:28:667 [Data Collector - usmemsmvcpvw01, vmware] vmware inventory alarm update started Mar 09 01:24:28:960 [Data Collector - usmemsmvcpvw01, vmware] vmware inventory alarm update completed in '293' milliseconds Mar 09 01:24:28:960 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1487 CurrentAllocated=1487 Free=854 Used=633 MB Mar 09 01:24:28:960 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Finding Device Deltas Mar 09 01:24:30:921 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Finding Device Deltas {Seconds=1.961} Finished finding Device Deltas. Mar 09 01:24:30:925 [Data Collector - usmemsmvcpvw01, vmware] Total inventory monitored: 14518 nodes. Mar 09 01:24:30:926 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Resolving Auto Monitors Mar 09 01:24:30:941 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Resolving Auto Monitors {Seconds=0.015} Mar 09 01:24:30:944 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=625 Used=878 MB Mar 09 01:24:30:945 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Sending qos for monitors Mar 09 01:24:30:948 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Sending qos for monitors {Seconds=0.003} Mar 09 01:24:30:948 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: Updating monitors in graph Mar 09 01:24:30:962 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: Updating monitors in graph {Seconds=0.014} Mar 09 01:24:30:962 [Data Collector - usmemsmvcpvw01, vmware] PERF: START: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. Mar 09 01:24:30:962 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: CtdSession: Calling DiscoveryPublisherService to send data to the UIM Discovery Service. {Seconds=0.000} Mar 09 01:24:30:962 [Data Collector - usmemsmvcpvw01, vmware] PERF: DataCollector for usmemsmvcpvw01 collected 271 monitors (auto=271, static=0) Mar 09 01:24:30:962 [Data Collector - usmemsmvcpvw01, vmware] PERF: DONE: ----- Pass-1702 --- Data Collector Check Interval for: usmemsmvcpvw01 {Seconds=9.783} Mar 09 01:24:30:962 [Data Collector - usmemsmvcpvw01, vmware] PERF: Memory Status: Max=1503 CurrentAllocated=1503 Free=616 Used=887 MB Mar 09 01:24:30:962 [Data Collector - usmemsmvcpvw01, vmware] DataCollector for usmemsmvcpvw01 finished collecting data