VCF on VxRail 4.5.1/7.0.451 - SDDC Manager 'VxRail Precheck' fails with "Read times out"

[MC1903]

And my woes with the VCF on VxRail upgrades continue with another bizarre issue...

So I am running SDDC upgrade prechecks on this instance and they take 1 hour to complete (previous upgrades on other instances this takes around 10 to 20 mins)

I cannot screen shot or log extract as this is an air-gapped system and the hoops to jump through are many, awkward and time consuming.

The precheck message is:

RED - {VxRail Manager Hostname} | VxRail System Precheck:
Error Description: Read times out
Impact: High: Do not perform upgrade without addressing this issue
Remediation: Please refer to LCM logs for a reason for system pre-check failures for VxRail Manager with resource id {GUID}

Looking through the /var/log/vmware/vcf/lcm/lcm.log for references to the {GUID}, there are many repeating references to:

• Unknown exception while parsing jwt token JWT expired at {date/time}. Current time: {date/time}, a difference of 71401742 milliseconds. Allowed clock skew: 0 milliseconds.
• System Precheck operation on VxRail {GUID} has timed out.
• Can't find resource for bundle java.util.PropertyResourceBundle, key VXRAIL_SYSTEM_PRECHECK_TIMEOUT
• General exception in executeVxManagerHttpRequest Read time out
• Error when performing VxRail Manager System Precheck for VxRail Manager with id {GUID}

I have confirmed time is in sync, both SDDC manager and VxRail Manager are using the same NTP source and are in sync.

I have executed the latest VCFVerify on SDDC Manager and VxVerify on the VxRail Manager, they both return with GREED/good status for everything.

I have tried rebooting both SDDC Manager & VxRail Manager, same error is reported.

I will open an SR today, but hoping someone has seen this before and has some ideas what needs to be done.

Cheers

M

[MC1903]

For anyone interested, the Dell VCF support chap fixed my issue as follows:

1. Snapshot VxRail Manager VM.
2. SSH in as 'mystic'
3. Switch to root with su -
4. Remove any radar locks with /mystic/radar/radar -k
5. Remove the directory /mystic/radar/report with rm -rf /mystic/radar/report
6. Remove the directory /mystic/radar/.task_store with rm -rf /mystic/radar/.task_store
7. Re-run the prechecks within SDDC Manager. The VxRail System Precheck should complete in a few minutes, possibly with a 'yellow' warning. This is OK.
8. If you are happy and all is good, delete the snapshot.

Usual disclaimers apply...

• Open a Support Case if you can.
• Follow the above at your own risk.
• Your mileage may vary.

Cheers,

M