VCB Backup - One stubborn VM!!

[patwpage]

I have managed to build a successful VCB infrastructure in which the majority of my virtual machines will backup nicely using VCB.

There is one holdout giving me this in the saveset report:

1 retry attempted

\[2007-03-13 10:39:39.886 'App' 4588 info] Current working directory: C:\

\[2007-03-13 10:39:40.573 'BaseLibs' 5744 warning] \[Vmdb_Unset] Unsetting unknown path: /vmomi/

\[2007-03-13 10:39:41.792 'vcbMounter' 4588 error] Error: Backup snapshot already exists.

\[2007-03-13 10:39:41.792 'vcbMounter' 4588 error] An error occured, cleaning up...

External command failed. See error above.

Exit Code: 1

*******************************************************

Networker 7.3.2 with compatibility Module

ESX 3.x

VC 3.x

guest os is windows 2k3

datastore is cx500

Anyone seen this kind of stuff with a VCB backup on one of their VM's?

Thanks,

[steve_higgins]

Looks like your VM has a leftover snapshot that was never committed (deleted) from a previous backup. Use the VI client and browse to the VM and use the Snapshot Manager button to delete the snapshots. Then you should be good to go.

[patwpage]

Thanks SO much!!

That did the trick. Still trying to get this whole VCB thing fully understood. Just had a successful backup of that VM and another that was doing the same thing.

I LOVE the forums!

[patwpage]

I'm getting this on another VM. I have full name resolution going on between the Networker server and the VM so I don't know how I could be getting this:

1 retry attempted

\[2007-03-14 12:26:33.218 'App' 2596 info] Current working directory: C:\

\[2007-03-14 12:26:33.781 'BaseLibs' 2988 warning] \[Vmdb_Unset] Unsetting unknown path: /vmomi/

\[2007-03-14 12:26:34.749 'vcbMounter' 2596 error] Error: Host is unreachable.

External command failed. See error above.

Exit Code: 1

[CSummers]

Make sure you are using the same DNS name case that is displayed when you view the server in VC.

[patwpage]

Hi,

The DNS name in VC is ASPTTS in upper case so I changed it to that in the SaveSet selection and got the same errors.

1 retry attempted

\[2007-03-19 06:58:15.070 'App' 5640 info] Current working directory: C:\

\[2007-03-19 06:58:15.617 'BaseLibs' 6092 warning] \[Vmdb_Unset] Unsetting unknown path: /vmomi/

\[2007-03-19 06:58:18.227 'vcbMounter' 5640 error] Error: Host is unreachable.

External command failed. See error above.

Exit Code: 1

This is the output in the Virtual Center Events screen:

Name Target Status

Create Virtual Machine Snapshot ASPTTS Unable to communicate with the remote host, since it is disconnected

Remove Snapshot ASPTTS Unable to communicate with the remote host, since it is disconnected

[mwheeler1982]

I have this same issue. Two of my VMs have names in uppercase, but one of them won't resolve. I've tried looking it up with vcbVmName and it just refuses to lookup that one machine. Good thing it's a test box and not a production one!

[steve_higgins]

When you run the 'esxtop' command, does it show you the proper name as it should with vcbVmName?

[mwheeler1982]

No, esxtop is showing the "friendly" name for the VM.

The VCB scripts specify the 'ipaddr:' switch to vcbMounter.exe .

[steve_higgins]

If the script is looking for ipaddr: it should return the actual IP, not the FQDN.

[mwheeler1982]

From glue.js in the VCB Framework:

// set the VM identifier. - In our case, it is always a DNS name

// or an IP address.

cmd += "-a ipaddr:" + VMinfo.name + " ";

This would lead me to believe that a DNS name will work. It works for all my other VMs.. It just doesn't like one of them for some reason...

[steve_higgins]

Ok, yes you are right, you can use either to query with vcbVmName. Both should work, but I guess in your case you may want to modify the script to return IP addresses instead of FQDN.

[mwheeler1982]

Exactly.. but I would like to figure out why it doesn't work.. I mean, come on.. DNS names came about so that people didn't have to remember IP Addresses. It would make my scripts look "cleaner" and easier to read/maintain if I could just use DNS names across the board.

[steve_higgins]

When you run the ESXBackup script do you specify :any to backup all vms? Or do you do PoweredON?

[mwheeler1982]

With VCB, you specify individual VMs to backup.

[steve_higgins]

Very sorry, I accidentally mixed my thread posts. Can you send the output of the vcbVmName for the stubborn VM and what the name should be?

[mwheeler1982]

Ah, well, I just figured out my issue.. We had an incorrect reverse DNS entry for the server it couldn't find...

[patwpage]

I'm using this command

VM:ASPTTS.ccchsd.gov:\*FULL*

The name of the vm in virtual center is ASPTTS in upper case. I've tried the command shown in upper and lower case with the same resut.

Here is output from nslookup. It appears to be resolving just fine and this was run from the Networker Server

H:\>nslookup

Default Server: ptdc1.ccchsd.gov

Address: 172.18.10.164

asptts

Server: ptdc1.ccchsd.gov

Address: 172.18.10.164

Name: asptts.ccchsd.gov

Address: 172.18.13.172

172.18.13.172

Server: ptdc1.ccchsd.gov

Address: 172.18.10.164

Name: asptts.ccchsd.gov

Address: 172.18.13.172

ASPTTS

Server: ptdc1.ccchsd.gov

Address: 172.18.10.164

Name: ASPTTS.ccchsd.gov

Address: 172.18.13.172

172.18.13.172

Server: ptdc1.ccchsd.gov

Address: 172.18.10.164

Name: asptts.ccchsd.gov

Address: 172.18.13.172

I use the save_vcb.bat in the client properties.

[mwheeler1982]

I know it sounds stupid, but have you verified that you can ping the VM and your ESX hosts from your VCB box? Do you have any sort of firewall on it that would prohibit VCB traffic?

[patwpage]

THAT is never stupid. It's the obvious things that people always miss. Thanks for the suggestion. Here is the output from the ping testing:

H:\>ping asptts

Pinging asptts.ccchsd.gov \[172.18.13.172] with 32 bytes of data:

Reply from 172.18.13.172: bytes=32 time<1ms TTL=125
Reply from 172.18.13.172: bytes=32 time<1ms TTL=125
Reply from 172.18.13.172: bytes=32 time<1ms TTL=125
Reply from 172.18.13.172: bytes=32 time<1ms TTL=125

Ping statistics for 172.18.13.172:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 0ms, Maximum = 0ms, Average = 0ms

H:\>ping 172.18.13.172

Pinging 172.18.13.172 with 32 bytes of data:

Reply from 172.18.13.172: bytes=32 time<1ms TTL=125
Reply from 172.18.13.172: bytes=32 time<1ms TTL=125
Reply from 172.18.13.172: bytes=32 time=1ms TTL=125
Reply from 172.18.13.172: bytes=32 time<1ms TTL=125

Ping statistics for 172.18.13.172:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 0ms, Maximum = 1ms, Average = 0ms

H:\>ping -a 172.18.13.172

Pinging asptts.ccchsd.gov \[172.18.13.172] with 32 bytes of data:

Reply from 172.18.13.172: bytes=32 time<1ms TTL=125

Reply from 172.18.13.172: bytes=32 time<1ms TTL=125

Reply from 172.18.13.172: bytes=32 time<1ms TTL=125

Reply from 172.18.13.172: bytes=32 time=1ms TTL=125

Ping statistics for 172.18.13.172:

Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),

Approximate round trip times in milli-seconds:

Minimum = 0ms, Maximum = 1ms, Average = 0ms

[mwheeler1982]

Does this VM reside on its own LUN or does it share a LUN with other working VMs? Is the LUN VMFS3?

Is VMware tools installed and functioning correctly? Maybe try to uninstall and reinstall the tools?

Does it have any snapshots left over from previous attempts? If so, they'd be called something like "\_VCB-BACKUP_" or "Consolidated Helper"

[patwpage]

Does this VM reside on its own LUN or does it share a LUN with other working VMs? Is the LUN VMFS3?

[i]It shares san luns with other vm's. All my vm's do.[/i][/b]

Is VMware tools installed and functioning correctly? Maybe try to uninstall and reinstall the tools?

[i]They are out of date, I will re-install tonight and try a backup tomorrow and update you with the results[/i][/b]

Does it have any snapshots left over from previous attempts? If so, they'd be called something like "\_VCB-BACKUP_" or "Consolidated Helper"

[b]I know about this. I deleted leftover snapshots before testing again. It leaves an orphaned snapshot every time if fails.[/b][/i]

The main thing from your message will be the updating of the vmware tools. Thanks for the suggestion!

[patwpage]

Yes, everything is 3.x vmfs, vc, esx, the whole works.

[mwheeler1982]

Did reinstaling VMTools fix the problem?

[patwpage]

No. Nothing has. What a drag! Here's the latest try:

***********************

NetWorker savegroup: (alert) Virtual Machines completed, Total 1 client(s), 1 Failed. Please see group completion details for more information.

Failed: mediasvr.ccchsd.gov

Start time: Thu Mar 29 16:06:06 2007

End time: Thu Mar 29 16:17:11 2007

\--- Unsuccessful Save Sets ---

\* mediasvr.ccchsd.gov:VM:asptts.ccchsd.gov:\*FULL* 1 retry attempted

\* mediasvr.ccchsd.gov:VM:asptts.ccchsd.gov:\*FULL* \[2007-03-29 16:14:32.641 'App' 1820 info] Current working directory: C:\

\* mediasvr.ccchsd.gov:VM:asptts.ccchsd.gov:\*FULL* \[2007-03-29 16:14:33.188 'BaseLibs' 3356 warning] \[Vmdb_Unset] Unsetting unknown path: /vmomi/

\* mediasvr.ccchsd.gov:VM:asptts.ccchsd.gov:\*FULL*

\* mediasvr.ccchsd.gov:VM:asptts.ccchsd.gov:\*FULL* \[2007-03-29 16:14:41.547 'vcbMounter' 1820 error] Error: No connection to host established.

\* mediasvr.ccchsd.gov:VM:asptts.ccchsd.gov:\*FULL* External command failed. See error above.

\* mediasvr.ccchsd.gov:VM:asptts.ccchsd.gov:\*FULL* Exit Code: 1

[patwpage]

I tried upper and lower case on this command that I use for each vm:

VM:ASPTTS.ccchsd.gov:\*FULL*

It doesn't work either way.