Vmware 5 virtual NIC stops working on VM Windows 2008

[AnnamariaCESI]

Hi all,

we have virtual infrastructure based on Vmware vSphere 5 since decembre 2011.

Storage system is based on Dell EqualLogic with iSCSI.

We have virtualized our physical Windows 2000/Windows 2003 servers and we have created new Windows 2008 server.

Some virtual servers have 2 NIC: one for LAN and one for iSCSI connection to storage (to connect volumes dedicated to DB, Exchange).

All was ok since yesterday when on 6 servers Windows 2008 all NIC configured didn't work.

These servers are all Windows 2008 R2 64b  but are different in functionality: print server (1 NIC LAN), SAP server (application + DB - 2 NIC, LAN and iSCSI), Exchange 2010 servers (all roles: NIC for LAN, iSCSI ,DAG).

In some situations was sufficient edit VM, remove VNIC, next add them again and restart VM.

In other case we had to remove network adapter from device manager on VM, add them again (in such way we reinstalled the driver) and restart VM.

This morning I found in same situation another SAP server  (only application).

Event viewer doesn't contain any information about corruption or other events linked to network adapters.

Another info:

Vmware Tools installed on VM's: 8.6.0.6868.

Thanks in advance for any suggestion or help.

Annamaria

[MartinAmaro]

What is the virtual machines hardware version?

what adapter type are they using (E1000, VMXNET 2 or VMXNET 3)

[AnnamariaCESI]

Hardware version is 8 for all the involved machines.

We always used E1000 type adapter.

In cases more difficult (when we had to remove network adapter from device manager consequently to the problem) we used VMXNET3 type.

[MartinAmaro]

Did you find anything of value in the Windows logs, virtual center logs or the ESX logs?

[AnnamariaCESI]

In Windows logs I didn't find anything of value only error caused by the loss of NIC (errors on lost connection of volume iSCSI , impossibility to establish connection with DC...).

Also in Vcenter Events (on Vsphere client) there are no significant messages or also apparently concerning the problem.

About logs on ESXi, between all the logs in /var/logs can you tell me which is more significant in this case ?

I have tail some of them, but i didn' t find or i didn't center the question.

[jjgunn]

Sounds like the dreaded "dead gateway" on Windows 2008.

Check to see if your gateway is entered on each of your Windows VM's. It will be blank.

I would also suggest using VMXNET3 instead of E1000. Disable all the offload features of the adapter too. Especially chimney

Command is below

netsh int tcp set global chimney=disabled

[MartinAmaro]

okay so only windows 2008 are affected and are they in different hosts?

Different virtual switches?

going back to the basics..when you log on the server having the issue, can you ping it self, gateway, DNS, etc?

[jjgunn]

Agree. Start with the basics, Check your Power Management tab in device manager to ensure the NIC isn't being turned off

[AnnamariaCESI]

Yes they are on different hosts, hosts are all in one cluster and use same distributed virtual switch

When a server is affected by issue i must connect to console and i'm not able to ping any server (DC DNS ecc..).

Annamaria

[MartinAmaro]

I'm having a hard time believing is the  virtual nic, how about changing the nic's virtual switch and giving it a valid IP for that subnet.

Also did you work with your network team to identify if your ESX physical nic's speed duplex match the switch port's configuration?

Have they looked at the network switch to idetify possible collisions?

How is your virtual swtich configured?

[AnnamariaCESI]

Hi Martin,

we have identified at least the cause of problem: only one of the servers ESXi in the cluster have an again identified problem that causes issues on VM’ s NIC hosted on itself.

We checked ESX physical NIC’s speed duplex and it matches with the switch port's configuration (1000 full duplex).

Again, on network switch ports there are no collisions or other type of error.

May you suggest us some other check to do?

Thanks

Annamaria

Annamaria Sacchi

Administration, Finance, Control, I&CT Department

Information & Communication Technology

Da: Martin Amaro

Inviato: venerdì 8 giugno 2012 17:21

A: Sacchi Annamaria

Oggetto: New message: "Vmware 5 virtual NIC stops working on VM Windows 2008"

VMware Communities<http://communities.vmware.com/index.jspa>

Vmware 5 virtual NIC stops working on VM Windows 2008

reply from Martin Amaro<http://communities.vmware.com/people/MartinAmaro> in VMware ESXi 5 - View the full discussion<http://communities.vmware.com/message/2057698#2057698

[AnnamariaCESI]

Problem still unsolved.

We 'll go to upgrade to Vmware ESXi 5.1.

Annamaria

[varoon]

Hi,

I am facing similar issue with 2003 r2.i did vmotion to another host and it started working.i know its not solution but i am still working on this.

we are using HPG7 with ESXi5.0.

Please let me know if you come to any solution.